Jun 04 14:36:44 devstack cinder-volume[75839]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:36:44 devstack cinder-volume[75839]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:36:44 devstack cinder-volume[75839]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:36:44 devstack cinder-volume[75839]: INFO dbcounter [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Registered counter for database cinder Jun 04 14:36:44 devstack cinder-volume[75839]: DEBUG oslo_db.sqlalchemy.engines [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:36:44 devstack cinder-volume[75839]: DEBUG dbcounter [-] [75839] Writer thread running {{(pid=75839) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 14:36:44 devstack cinder-volume[75839]: INFO cinder.rpc [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 14:36:44 devstack cinder-volume[75839]: INFO cinder.rpc [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 14:36:44 devstack cinder-volume[75839]: DEBUG oslo_db.sqlalchemy.engines [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:36:45 devstack cinder-volume[75839]: INFO cinder.volume.manager [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Determined volume DB was empty at startup. Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG cinder.volume.manager [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75839) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 04 14:36:45 devstack cinder-volume[75839]: INFO cinder.volume.manager [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 14:36:45 devstack cinder-volume[75839]: WARNING stevedore.named [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 14:36:45 devstack cinder-volume[75839]: WARNING castellan.key_manager [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:36:45 devstack cinder-volume[75839]: WARNING cinder.keymgr.conf_key_mgr [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG cinder.volume.drivers.lvm [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75839) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_concurrency.processutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_concurrency.processutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.331s {{(pid=75839) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_db.sqlalchemy.engines [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:36:45 devstack cinder-volume[75839]: INFO cinder.rpc [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 04 14:36:45 devstack cinder-volume[75839]: INFO cinder.rpc [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 04 14:36:45 devstack cinder-volume[75839]: WARNING stevedore.named [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 14:36:45 devstack cinder-volume[75839]: WARNING castellan.key_manager [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:36:45 devstack cinder-volume[75839]: INFO cinder.volume.manager [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_db.sqlalchemy.engines [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:36:45 devstack cinder-volume[75839]: INFO oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Starting 1 workers Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Started child 76012 {{(pid=75839) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Full set of CONF: {{(pid=75839) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] ******************************************************************************** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Configuration options gathered from: {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] ================================================================================ {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] allow_availability_zone_fallback = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] allow_compression_on_image_upload = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] allowed_direct_url_schemes = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] api_rate_limit = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] auth_strategy = keystone {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] az_cache_duration = 3600 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_availability_zone = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[76012]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_host = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_stats_polling_interval = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backup_api_class = cinder.backup.api.API {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backup_name_template = backup-%s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backup_use_same_host = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backup_use_temp_snapshot = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] chap_password = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] chap_username = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_internal_tenant_project_id = 1655c9b89e714dd9bd5cc1bcb76eb2cd {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_internal_tenant_user_id = b29d2ad9f0e6457b8542f46621eb04d2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cloned_volume_same_az = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cluster = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] compression_format = gzip {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] compute_api_class = cinder.compute.nova.API {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] config_dir = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] config_source = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] control_exchange = openstack {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] debug = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] default_availability_zone = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] default_group_type = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] default_volume_type = lvmdriver-1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] disk_geometry = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] driver_client_cert = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] driver_client_cert_key = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] driver_data_namespace = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] driver_ssl_cert_path = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] driver_ssl_cert_verify = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] driver_use_ssl = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] enable_force_upload = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] enable_new_services = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] enable_unsupported_driver = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] enforce_multipath_for_image_xfer = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] filter_function = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_api_insecure = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_api_ssl_compression = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_ca_certificates_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_catalog_info = image:glance:publicURL {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_num_retries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance_request_timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] goodness_function = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] graceful_shutdown_timeout = 5 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] group_api_class = cinder.group.api.API {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] host = devstack {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_compress_on_upload = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_conversion_address_space_limit = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_conversion_cpu_limit = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_conversion_disable = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_upload_use_cinder_backend = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_upload_use_internal_tenant = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_volume_cache_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_volume_cache_max_count = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] init_host_max_objects_retrieval = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] instance_format = [instance: %(uuid)s] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] iscsi_target_flags = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] iscsi_write_cache = on {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] iser_helper = tgtadm {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] iser_ip_address = 192.168.122.168 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] iser_port = 3260 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_color = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_config_append = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_dir = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_options = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_rotate_interval = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_rotate_interval_type = days {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] log_rotation_type = none {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack sudo[76017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:45 devstack sudo[76017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] max_age = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] max_logfile_count = 30 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] max_logfile_size_mb = 200 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] max_over_subscription_ratio = 20.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] message_reap_interval = 86400 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] message_ttl = 2592000 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] monkey_patch = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] monkey_patch_modules = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] my_ip = 192.168.122.168 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] no_snapshot_gb_quota = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] num_iser_scan_tries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] num_shell_tries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] num_volume_device_scan_tries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] nvmeof_conn_info_version = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] nvmet_ns_id = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] nvmet_port_id = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_max_limit = 1000 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_volume_ext_list = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_volume_listen_port = 8776 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_volume_use_ssl = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] osapi_volume_workers = 2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] per_volume_size_limit = -1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] periodic_fuzzy_delay = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] periodic_interval = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] public_endpoint = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] publish_errors = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_backup_gigabytes = 1000 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_backups = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_gigabytes = 1000 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_groups = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_snapshots = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] quota_volumes = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] rate_limit_burst = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] rate_limit_except_level = CRITICAL {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] rate_limit_interval = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] reinit_driver_count = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] replication_device = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] report_discard_supported = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] report_interval = 120 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] reservation_clean_interval = 86400 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] reservation_expire = 86400 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] reserved_image_namespaces = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] reserved_percentage = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] rpc_response_timeout = 120 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] run_external_periodic_tasks = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] scst_target_driver = iscsi {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] scst_target_iqn_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_down_time = 720 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] shell_completion = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] snapshot_name_template = snapshot-%s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] snapshot_same_host = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] split_loggers = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] state_path = /opt/stack/data/cinder {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] storage_availability_zone = nova {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] storage_protocol = iSCSI {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] syslog_log_facility = LOG_USER {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] target_helper = lioadm {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] target_ip_address = 192.168.122.168 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] target_port = 3260 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] target_protocol = iscsi {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] target_secondary_ip_addresses = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] trace_flags = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] transport_url = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] until_refresh = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_chap_auth = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_default_quota_class = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_journal = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_json = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_multipath_for_image_xfer = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_stderr = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] use_syslog = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] verify_glance_signatures = enabled {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_api_class = cinder.volume.api.API {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_backend_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_clear = zero {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_clear_ionice = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_clear_size = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_copy_bps_limit = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_dd_blocksize = 1M {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_name_template = volume-%s {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_service_inithost_offload = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volume_usage_audit_period = month {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] zoning_mode = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.admin_password = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.admin_token = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.admin_user = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_port = 35357 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_protocol = https {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_section = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_type = password {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_uri = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.auth_version = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.cache = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.identity_uri = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.insecure = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.interface = public {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_password = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcache_username = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.region_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.service_type = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.backend = dogpile.cache.null {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.backend_argument = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.backend_expiration_time = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.config_prefix = cache.oslo {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.debug_cache_backend = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.enable_retry_client = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.enable_socket_keepalive = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.enforce_fips_mode = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.expiration_time = 600 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_dead_retry = 300 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_sasl_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.password = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.proxies = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.redis_db = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.redis_server = localhost:6379 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.retry_attempts = 2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.retry_delay = 0.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.socket_keepalive_count = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.socket_keepalive_idle = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.socket_keepalive_interval = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.socket_timeout = 1.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.tls_allowed_ciphers = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.tls_cafile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.tls_certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.tls_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.tls_keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cache.username = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] coordination.backend_url = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.asyncio_connection = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.asyncio_slave_connection = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.backend = sqlalchemy {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.connection = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.connection_debug = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.connection_parameters = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.connection_recycle_time = 3600 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.connection_trace = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.db_inc_retry_interval = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.db_max_retries = 20 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.db_max_retry_interval = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.db_retry_interval = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.max_overflow = 50 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.max_pool_size = 5 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.max_retries = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.pool_timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.retry_interval = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.slave_connection = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.sqlite_synchronous = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.synchronous_reader = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] database.use_db_reconnect = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.connection_string = messaging:// {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.es_doc_type = notification {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.es_scroll_size = 10000 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.es_scroll_time = 2m {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.filter_error_trace = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.hmac_keys = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.sentinel_service_name = mymaster {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.socket_timeout = 0.1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.trace_requests = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler.trace_sqlalchemy = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler_jaeger.process_tags = {} {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] profiler_otlp.service_name_prefix = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.enforce_new_defaults = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: WARNING oslo_config.cfg [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.enforce_scope = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.policy_default_rule = default {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.group = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.helper_command = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] privsep_osbrick.user = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.group = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.helper_command = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] cinder_sys_admin.user = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.auth_section = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.auth_type = password {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.cafile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.collect_timing = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.insecure = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.send_service_user_token = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.split_loggers = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] service_user.timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.auth_section = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.auth_type = password {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.collect_timing = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.insecure = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.region_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.split_loggers = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] glance.timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.backend_availability_zone = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.chap_password = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.chap_username = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.disk_geometry = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.driver_client_cert = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.driver_data_namespace = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.driver_use_ssl = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.extra_capabilities = {} {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.filter_function = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.goodness_function = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.iscsi_target_flags = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.iser_helper = tgtadm {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.iser_port = 3260 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.lvm_share_target = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.lvm_type = auto {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.replication_device = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.report_discard_supported = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.target_helper = tgtadm {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.target_port = 3260 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.target_protocol = iscsi {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.trace_flags = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.use_chap_auth = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_backend_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_clear = zero {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_reports.file_event_handler = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_reports.log_dir = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.backend_host = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.chap_password = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.chap_username = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.disk_geometry = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.filter_function = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.goodness_function = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.iser_helper = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.iser_ip_address = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.iser_port = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.lvm_share_target = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.lvm_type = auto {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.num_shell_tries = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.replication_device = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.storage_protocol = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.target_helper = lioadm {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.target_ip_address = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.target_port = 3260 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.trace_flags = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.use_chap_auth = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_clear = zero {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_clear_size = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] lvmdriver-1.volumes_dir = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_notifications.driver = [] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] key_manager.fixed_key = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.barbican_api_version = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.barbican_endpoint = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.barbican_endpoint_type = public {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.barbican_region_name = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.cafile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.collect_timing = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.insecure = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.number_of_retries = 60 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.retry_delay = 1 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.send_service_user_token = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.split_loggers = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.verify_ssl = True {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican.verify_ssl_path = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.auth_section = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.auth_type = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.cafile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.certfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.collect_timing = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.insecure = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.keyfile = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.split_loggers = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] barbican_service_user.timeout = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.approle_role_id = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.approle_secret_id = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.kv_mountpoint = secret {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.kv_path = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.kv_version = 2 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.namespace = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.root_token_id = **** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.ssl_ca_crt_file = None {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.timeout = 60.0 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.use_ssl = False {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:36:46 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] ******************************************************************************** {{(pid=75839) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 14:36:46 devstack sudo[76017]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:46 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:46 devstack sudo[76100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:46 devstack sudo[76100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:47 devstack sudo[76100]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.619s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:36:47 devstack cinder-volume[76012]: INFO cinder.brick.local_dev.lvm [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:47 devstack sudo[76352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:36:47 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:47 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG cinder.brick.local_dev.lvm [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76012) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 04 14:36:47 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:47 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:47 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:49 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.299s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:49 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:49 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:49 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.715s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:49 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:50 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:50 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 04 14:36:50 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:50 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:50 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.664s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:50 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:50 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:36:50 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:51 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:51 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:51 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:51 devstack sudo[76810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:36:51 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:52 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:52 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:52 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:52 devstack sudo[76813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:36:52 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:52 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:52 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.790s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:52 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:52 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:52 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:53 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:53 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.788s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:53 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:53 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:53 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:53 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:53 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:54 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:54 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:54 devstack cinder-volume[76012]: INFO cinder.volume.drivers.lvm [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 04 14:36:54 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:54 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:54 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:54 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:54 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:55 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:55 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:55 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 14:36:55 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:55 devstack sudo[76954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:36:55 devstack sudo[76954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:55 devstack sudo[76954]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:55 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:55 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:55 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:36:55 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:55 devstack cinder-volume[75839]: DEBUG dbcounter [-] [75839] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75839) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:36:56 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:56 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:56 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:56 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:56 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:56 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:56 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.589s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:56 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:56 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:36:56 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:57 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:57 devstack cinder-volume[76012]: INFO cinder.volume.driver [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG cinder.volume.driver [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76012) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writer thread running {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG cinder.db.sqlalchemy.api [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Building query based on filter {{(pid=76012) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG cinder.image.image_utils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76012) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 04 14:36:57 devstack cinder-volume[76012]: INFO cinder.keymgr.migration [None req-22f8b55b-dac9-4ac7-bdcf-522dd89f5341 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 14:36:57 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:57 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:36:57 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:58 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:58 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:58 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:58 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:36:58 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:58 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:58 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:58 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:58 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:36:58 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:36:59 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Jun 04 14:36:59 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:36:59 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:36:59 devstack sudo[77122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:36:59 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:37:00 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:37:00 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Driver initialization completed successfully. Jun 04 14:37:00 devstack cinder-volume[76012]: INFO cinder.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Initiating service 2 cleanup Jun 04 14:37:00 devstack cinder-volume[76012]: INFO cinder.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Service 2 cleanup completed. Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG cinder.service [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Creating RPC server for service cinder-volume {{(pid=76012) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG cinder.service [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76012) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 14:37:00 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:37:00 devstack sudo[77126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:37:00 devstack sudo[77126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:37:00 devstack sudo[77126]: pam_unix(sudo:session): session closed for user root Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:37:00 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:37:00 devstack sudo[77132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:37:00 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:37:01 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root Jun 04 14:37:01 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:37:01 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:37:01 devstack sudo[77158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:37:01 devstack sudo[77158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:37:02 devstack sudo[77158]: pam_unix(sudo:session): session closed for user root Jun 04 14:37:02 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.582s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:37:02 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:37:02 devstack sudo[77193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:37:02 devstack sudo[77193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:37:02 devstack sudo[77193]: pam_unix(sudo:session): session closed for user root Jun 04 14:37:02 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:37:02 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-d1da852c-180f-4d5c-b0f8-5a3577378b33 None None] Driver post RPC initialization completed successfully. Jun 04 14:37:12 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=3 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:37:12 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:38:36 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:38:36 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 14:38:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:38:36 devstack sudo[81922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:38:36 devstack sudo[81922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:38:37 devstack sudo[81922]: pam_unix(sudo:session): session closed for user root Jun 04 14:38:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:38:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:38:37 devstack sudo[81927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:38:37 devstack sudo[81927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:38:37 devstack sudo[81927]: pam_unix(sudo:session): session closed for user root Jun 04 14:38:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:38:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:38:37 devstack sudo[81947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:38:37 devstack sudo[81947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:38:38 devstack sudo[81947]: pam_unix(sudo:session): session closed for user root Jun 04 14:38:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.560s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:38:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:38:38 devstack sudo[81950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:38:38 devstack sudo[81950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:38:38 devstack sudo[81950]: pam_unix(sudo:session): session closed for user root Jun 04 14:38:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:38:39 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:39:12 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:39:12 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:39:36 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:39:36 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 14:39:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:39:36 devstack sudo[83227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:39:36 devstack sudo[83227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:39:37 devstack sudo[83227]: pam_unix(sudo:session): session closed for user root Jun 04 14:39:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:39:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:39:37 devstack sudo[83231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:39:37 devstack sudo[83231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:39:37 devstack sudo[83231]: pam_unix(sudo:session): session closed for user root Jun 04 14:39:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:39:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:39:37 devstack sudo[83248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:39:37 devstack sudo[83248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:39:38 devstack sudo[83248]: pam_unix(sudo:session): session closed for user root Jun 04 14:39:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.574s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:39:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:39:38 devstack sudo[83263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:39:38 devstack sudo[83263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:39:39 devstack sudo[83263]: pam_unix(sudo:session): session closed for user root Jun 04 14:39:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.566s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:39:39 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:40:36 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:40:36 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 14:40:36 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:40:36 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 14:40:36 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:40:37 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Jun 04 14:40:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:40:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:40:37 devstack sudo[84783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:40:37 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:40:37 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root Jun 04 14:40:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:40:37 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:40:37 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 14:40:37 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:40:38 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Jun 04 14:40:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.569s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:40:38 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:40:38 devstack sudo[84827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 14:40:38 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:40:39 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root Jun 04 14:40:39 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:40:39 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8e0ef472-f0d1-4d23-b943-dd9fafae8d0d None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:41:12 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:41:12 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:41:18 devstack cinder-volume[75839]: INFO oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Caught SIGTERM, stopping children Jun 04 14:41:18 devstack cinder-volume[75839]: DEBUG oslo_concurrency.lockutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Acquiring lock "singleton_lock" {{(pid=75839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:41:18 devstack cinder-volume[75839]: DEBUG oslo_concurrency.lockutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Acquired lock "singleton_lock" {{(pid=75839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:41:18 devstack cinder-volume[75839]: DEBUG oslo_concurrency.lockutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Releasing lock "singleton_lock" {{(pid=75839) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:41:18 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Stop services. {{(pid=75839) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 04 14:41:18 devstack cinder-volume[75839]: DEBUG oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Killing children. {{(pid=75839) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 04 14:41:18 devstack cinder-volume[75839]: INFO oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Waiting on 1 children to exit Jun 04 14:41:20 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Acquiring lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:41:20 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Acquired lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:41:20 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Releasing lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:41:20 devstack cinder-volume[76012]: WARNING amqp [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 14:41:20 devstack cinder-volume[76012]: WARNING amqp [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 14:41:20 devstack cinder-volume[75839]: INFO oslo_service.backend._eventlet.service [None req-6cebcb40-58eb-48df-a105-8c298ceaa5e4 None None] Child 76012 exited with status 0 Jun 04 14:41:22 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:41:22 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:41:22 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:41:23 devstack cinder-volume[85743]: INFO dbcounter [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Registered counter for database cinder Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG dbcounter [-] [85743] Writer thread running {{(pid=85743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 14:41:23 devstack cinder-volume[85743]: INFO cinder.rpc [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 14:41:23 devstack cinder-volume[85743]: INFO cinder.rpc [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:23 devstack cinder-volume[85743]: INFO cinder.volume.manager [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Determined volume DB was empty at startup. Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG cinder.volume.manager [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85743) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 04 14:41:23 devstack cinder-volume[85743]: INFO cinder.volume.manager [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 14:41:23 devstack cinder-volume[85743]: WARNING stevedore.named [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 14:41:23 devstack cinder-volume[85743]: WARNING castellan.key_manager [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:41:23 devstack cinder-volume[85743]: WARNING cinder.keymgr.conf_key_mgr [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:41:23 devstack cinder-volume[85743]: INFO cinder.volume.manager [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:23 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Starting 1 workers Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Started child 85879 {{(pid=85743) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Full set of CONF: {{(pid=85743) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] ******************************************************************************** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Configuration options gathered from: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] ================================================================================ {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] allow_availability_zone_fallback = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] allow_compression_on_image_upload = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] allowed_direct_url_schemes = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] api_rate_limit = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] auth_strategy = keystone {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_host = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_stats_polling_interval = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backup_api_class = cinder.backup.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backup_name_template = backup-%s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backup_use_same_host = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backup_use_temp_snapshot = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] chap_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] chap_username = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_internal_tenant_project_id = 1655c9b89e714dd9bd5cc1bcb76eb2cd {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_internal_tenant_user_id = b29d2ad9f0e6457b8542f46621eb04d2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cluster = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] compression_format = gzip {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] config_dir = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] config_source = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] control_exchange = openstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] debug = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] default_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] default_group_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85879]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] default_volume_type = QuobyteHD {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] disk_geometry = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] driver_client_cert = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] driver_client_cert_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] driver_data_namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] driver_ssl_cert_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] driver_ssl_cert_verify = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] driver_use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] enable_new_services = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] enable_unsupported_driver = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] enabled_backends = ['QuobyteHD'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] enforce_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] filter_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_api_insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_api_ssl_compression = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_ca_certificates_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_num_retries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance_request_timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] goodness_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] graceful_shutdown_timeout = 5 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] group_api_class = cinder.group.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] host = devstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_compress_on_upload = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_conversion_address_space_limit = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_conversion_cpu_limit = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_conversion_disable = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_upload_use_cinder_backend = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_upload_use_internal_tenant = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_volume_cache_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_volume_cache_max_count = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] init_host_max_objects_retrieval = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] instance_format = [instance: %(uuid)s] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] iscsi_target_flags = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] iscsi_write_cache = on {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] iser_helper = tgtadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] iser_ip_address = 192.168.122.168 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] iser_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_color = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_config_append = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_dir = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_options = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_rotate_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_rotate_interval_type = days {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] log_rotation_type = none {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] max_age = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] max_logfile_count = 30 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] max_logfile_size_mb = 200 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] max_over_subscription_ratio = 20.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] message_reap_interval = 86400 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] message_ttl = 2592000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] monkey_patch = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] monkey_patch_modules = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] my_ip = 192.168.122.168 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] no_snapshot_gb_quota = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] num_iser_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] num_shell_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] num_volume_device_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] nvmeof_conn_info_version = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] nvmet_ns_id = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] nvmet_port_id = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_max_limit = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_volume_ext_list = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_volume_listen_port = 8776 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_volume_use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] osapi_volume_workers = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] per_volume_size_limit = -1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] periodic_fuzzy_delay = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] periodic_interval = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] public_endpoint = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] publish_errors = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_backup_gigabytes = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_backups = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_gigabytes = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_groups = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_snapshots = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] quota_volumes = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] rate_limit_burst = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] rate_limit_except_level = CRITICAL {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] rate_limit_interval = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] reinit_driver_count = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] replication_device = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] report_discard_supported = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] report_interval = 120 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] reservation_clean_interval = 86400 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] reservation_expire = 86400 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] reserved_image_namespaces = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] reserved_percentage = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] rpc_response_timeout = 120 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] run_external_periodic_tasks = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] scst_target_driver = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] scst_target_iqn_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_down_time = 720 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] shell_completion = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] snapshot_name_template = snapshot-%s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] state_path = /opt/stack/data/cinder {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] storage_availability_zone = nova {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] storage_protocol = iSCSI {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] syslog_log_facility = LOG_USER {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] target_helper = lioadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] target_ip_address = 192.168.122.168 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] target_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] target_protocol = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] target_secondary_ip_addresses = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] trace_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] transport_url = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] until_refresh = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_chap_auth = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_default_quota_class = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_journal = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_json = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_stderr = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] use_syslog = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] verify_glance_signatures = enabled {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_api_class = cinder.volume.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_backend_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_clear = zero {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_clear_ionice = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_clear_size = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_copy_bps_limit = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_dd_blocksize = 1M {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_name_template = volume-%s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_service_inithost_offload = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volume_usage_audit_period = month {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] zoning_mode = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.admin_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.admin_token = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.admin_user = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_port = 35357 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_protocol = https {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_type = password {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_uri = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.auth_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.cache = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.identity_uri = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.interface = public {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_password = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcache_username = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.region_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.service_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.backend = dogpile.cache.null {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.backend_argument = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.backend_expiration_time = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.config_prefix = cache.oslo {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.debug_cache_backend = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.enable_retry_client = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.enable_socket_keepalive = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.enforce_fips_mode = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.expiration_time = 600 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_dead_retry = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_sasl_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.proxies = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.redis_db = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.redis_server = localhost:6379 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.retry_attempts = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.retry_delay = 0.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.socket_keepalive_count = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.socket_keepalive_idle = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.socket_keepalive_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.socket_timeout = 1.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.tls_allowed_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.tls_cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.tls_certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.tls_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.tls_keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cache.username = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] coordination.backend_url = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.asyncio_connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.asyncio_slave_connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.backend = sqlalchemy {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.connection_debug = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.connection_parameters = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.connection_recycle_time = 3600 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.connection_trace = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.db_inc_retry_interval = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.db_max_retries = 20 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.db_max_retry_interval = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.db_retry_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.max_overflow = 50 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.max_pool_size = 5 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.max_retries = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.pool_timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.retry_interval = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.slave_connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.sqlite_synchronous = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Starting volume driver QuobyteDriver (1.1.14) Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.synchronous_reader = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] database.use_db_reconnect = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.connection_string = messaging:// {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.es_doc_type = notification {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.es_scroll_size = 10000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.es_scroll_time = 2m {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.filter_error_trace = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.hmac_keys = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.sentinel_service_name = mymaster {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.socket_timeout = 0.1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.remotefs [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85879) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.trace_requests = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler.trace_sqlalchemy = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler_jaeger.process_tags = {} {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] profiler_otlp.service_name_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.enforce_new_defaults = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: WARNING oslo_config.cfg [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.enforce_scope = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.policy_default_rule = default {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.group = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.helper_command = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] privsep_osbrick.user = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.group = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.helper_command = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] cinder_sys_admin.user = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.auth_type = password {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.send_service_user_token = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] service_user.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.auth_type = password {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.region_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] glance.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.backend_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.chap_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.chap_username = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.disk_geometry = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.driver_client_cert = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.driver_data_namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.driver_use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.extra_capabilities = {} {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.filter_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.goodness_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.iscsi_target_flags = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.iser_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_host = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_login = admin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_mount_options = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_private_key = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_share_path = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.replication_device = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.report_discard_supported = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.target_helper = tgtadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.target_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.target_protocol = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.trace_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.use_chap_auth = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_backend_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_clear = zero {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_reports.file_event_handler = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_reports.log_dir = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.backend_host = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.chap_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.chap_username = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.chiscsi_conf = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.disk_geometry = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.driver_client_cert = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.driver_use_ssl = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.extra_capabilities = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.filter_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.goodness_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.iser_helper = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.iser_ip_address = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.iser_port = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.iser_target_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_host = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_login = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_mount_options = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_private_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_share_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_ssh_port = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.num_shell_tries = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.nvmet_port_id = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.replication_device = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.report_discard_supported = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.reserved_percentage = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.scst_target_driver = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.storage_protocol = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.target_helper = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.target_ip_address = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.target_port = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.target_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.target_protocol = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.trace_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.use_chap_auth = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_clear = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_clear_size = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] QuobyteHD.volumes_dir = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_notifications.driver = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] key_manager.fixed_key = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.barbican_api_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.barbican_endpoint = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.barbican_endpoint_type = public {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.barbican_region_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.number_of_retries = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.retry_delay = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.send_service_user_token = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.verify_ssl = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican.verify_ssl_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.auth_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] barbican_service_user.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.approle_role_id = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.approle_secret_id = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.kv_mountpoint = secret {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.kv_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.kv_version = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.root_token_id = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.ssl_ca_crt_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.timeout = 60.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:23 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] ******************************************************************************** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 14:41:23 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85879) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 04 14:41:23 devstack cinder-volume[85879]: WARNING cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 04 14:41:23 devstack cinder-volume[85879]: WARNING cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 04 14:41:23 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Running cmd (subprocess): mount.quobyte {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:24 devstack quobyte-client[85957]: Reading configuration file: /etc/quobyte/client.cfg Jun 04 14:41:24 devstack quobyte-client[85957]: Invalid parameters found, error: missing mount point. Jun 04 14:41:24 devstack quobyte-client[85957]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 04 14:41:24 devstack quobyte-client[85957]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:41:24 devstack cinder-volume[85879]: INFO cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 ... Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c -c /etc/quobyte/client-cinder.cfg {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:24 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c -c /etc/quobyte/client-cinder.cfg Jun 04 14:41:24 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:24 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.725s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:24 devstack cinder-volume[85879]: INFO cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 succeeded Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.736s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:41:24 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:24 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:41:24 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:25 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.554s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:25 devstack cinder-volume[85879]: INFO cinder.volume.driver [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Driver hasn't implemented _init_vendor_properties() Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG cinder.volume.driver [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85879) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_db.sqlalchemy.engines [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG dbcounter [-] [85879] Writer thread running {{(pid=85879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG cinder.db.sqlalchemy.api [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Building query based on filter {{(pid=85879) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG cinder.image.image_utils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85879) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 04 14:41:25 devstack cinder-volume[85879]: INFO cinder.keymgr.migration [None req-64e32c47-f42c-4812-9e20-b24b3da67719 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:25 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:41:25 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:25 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.563s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:25 devstack cinder-volume[85879]: DEBUG cinder.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Notifying Schedulers of capabilities ... {{(pid=85879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:41:25 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Driver initialization completed successfully. Jun 04 14:41:25 devstack cinder-volume[85879]: INFO cinder.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Initiating service 3 cleanup Jun 04 14:41:26 devstack cinder-volume[85879]: INFO cinder.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Service 3 cleanup completed. Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG cinder.service [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Creating RPC server for service cinder-volume {{(pid=85879) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG cinder.service [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85879) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 14:41:26 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:26 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:41:26 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:26 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.592s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:26 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-1f416689-6b24-44b6-9f56-05f74c16910d None None] Driver post RPC initialization completed successfully. Jun 04 14:41:30 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Caught SIGTERM, stopping children Jun 04 14:41:30 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Acquiring lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:41:30 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Acquired lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:41:30 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Releasing lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:41:30 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Stop services. {{(pid=85743) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 04 14:41:30 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Killing children. {{(pid=85743) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 04 14:41:30 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Waiting on 1 children to exit Jun 04 14:41:34 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Acquiring lock "singleton_lock" {{(pid=85879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:41:34 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Acquired lock "singleton_lock" {{(pid=85879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:41:34 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Releasing lock "singleton_lock" {{(pid=85879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:41:34 devstack cinder-volume[85879]: WARNING amqp [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 14:41:34 devstack cinder-volume[85879]: WARNING amqp [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 14:41:34 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-8d8fa409-1adb-4478-86e6-1285a663f1a2 None None] Child 85879 exited with status 0 Jun 04 14:41:37 devstack cinder-volume[86247]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 14:41:37 devstack cinder-volume[86247]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 14:41:37 devstack cinder-volume[86247]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 14:41:37 devstack cinder-volume[86247]: INFO dbcounter [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Registered counter for database cinder Jun 04 14:41:37 devstack cinder-volume[86247]: DEBUG oslo_db.sqlalchemy.engines [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG dbcounter [-] [86247] Writer thread running {{(pid=86247) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 14:41:38 devstack cinder-volume[86247]: INFO cinder.rpc [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 14:41:38 devstack cinder-volume[86247]: INFO cinder.rpc [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_db.sqlalchemy.engines [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:38 devstack cinder-volume[86247]: INFO cinder.volume.manager [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Determined volume DB was empty at startup. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG cinder.volume.manager [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86247) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 04 14:41:38 devstack cinder-volume[86247]: WARNING stevedore.named [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 14:41:38 devstack cinder-volume[86247]: WARNING castellan.key_manager [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:41:38 devstack cinder-volume[86247]: WARNING cinder.keymgr.conf_key_mgr [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 14:41:38 devstack cinder-volume[86247]: INFO cinder.volume.manager [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_db.sqlalchemy.engines [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:38 devstack cinder-volume[86247]: INFO oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Starting 1 workers Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Started child 86522 {{(pid=86247) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Full set of CONF: {{(pid=86247) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] ******************************************************************************** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Configuration options gathered from: {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] ================================================================================ {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] allow_availability_zone_fallback = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] allow_compression_on_image_upload = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] allowed_direct_url_schemes = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] api_rate_limit = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] auth_strategy = keystone {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86522]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_availability_zone = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_host = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_stats_polling_interval = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backup_api_class = cinder.backup.api.API {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backup_name_template = backup-%s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backup_use_same_host = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backup_use_temp_snapshot = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] chap_password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] chap_username = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_internal_tenant_project_id = 1655c9b89e714dd9bd5cc1bcb76eb2cd {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_internal_tenant_user_id = b29d2ad9f0e6457b8542f46621eb04d2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cluster = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] compression_format = gzip {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] config_dir = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] config_source = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] control_exchange = openstack {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] debug = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] default_availability_zone = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] default_group_type = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] default_volume_type = QuobyteHD {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] disk_geometry = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] driver_client_cert = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] driver_client_cert_key = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] driver_data_namespace = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] driver_ssl_cert_path = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] driver_ssl_cert_verify = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] driver_use_ssl = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] enable_new_services = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] enable_unsupported_driver = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] enforce_multipath_for_image_xfer = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] filter_function = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_api_insecure = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_api_ssl_compression = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_ca_certificates_file = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_num_retries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance_request_timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] goodness_function = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] graceful_shutdown_timeout = 5 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] group_api_class = cinder.group.api.API {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] host = devstack {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_compress_on_upload = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_conversion_address_space_limit = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_conversion_cpu_limit = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_conversion_disable = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_upload_use_cinder_backend = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_upload_use_internal_tenant = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_volume_cache_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_volume_cache_max_count = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] init_host_max_objects_retrieval = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] instance_format = [instance: %(uuid)s] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] iscsi_target_flags = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] iscsi_write_cache = on {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] iser_helper = tgtadm {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] iser_ip_address = 192.168.122.168 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] iser_port = 3260 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_color = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_config_append = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_dir = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_file = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_options = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_rotate_interval = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_rotate_interval_type = days {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] log_rotation_type = none {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] max_age = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] max_logfile_count = 30 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] max_logfile_size_mb = 200 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] max_over_subscription_ratio = 20.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] message_reap_interval = 86400 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] message_ttl = 2592000 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] monkey_patch = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] monkey_patch_modules = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] my_ip = 192.168.122.168 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] no_snapshot_gb_quota = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] num_iser_scan_tries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] num_shell_tries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] num_volume_device_scan_tries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] nvmeof_conn_info_version = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] nvmet_ns_id = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] nvmet_port_id = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_max_limit = 1000 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_volume_ext_list = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_volume_listen_port = 8776 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_volume_use_ssl = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] osapi_volume_workers = 2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] per_volume_size_limit = -1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] periodic_fuzzy_delay = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] periodic_interval = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] public_endpoint = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] publish_errors = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_backup_gigabytes = 1000 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_backups = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_gigabytes = 1000 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_groups = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_snapshots = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86522) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] quota_volumes = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] rate_limit_burst = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] rate_limit_except_level = CRITICAL {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] rate_limit_interval = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] reinit_driver_count = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] replication_device = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] report_discard_supported = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] report_interval = 120 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] reservation_clean_interval = 86400 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] reservation_expire = 86400 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] reserved_image_namespaces = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] reserved_percentage = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] rpc_response_timeout = 120 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] run_external_periodic_tasks = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] scst_target_driver = iscsi {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] scst_target_iqn_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_down_time = 720 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] shell_completion = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] snapshot_name_template = snapshot-%s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] split_loggers = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] state_path = /opt/stack/data/cinder {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] storage_availability_zone = nova {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] storage_protocol = iSCSI {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] syslog_log_facility = LOG_USER {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] target_helper = lioadm {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] target_ip_address = 192.168.122.168 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] target_port = 3260 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] target_protocol = iscsi {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] target_secondary_ip_addresses = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] trace_flags = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] transport_url = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] until_refresh = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_chap_auth = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_default_quota_class = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_journal = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_json = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_multipath_for_image_xfer = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_stderr = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] use_syslog = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] verify_glance_signatures = enabled {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_api_class = cinder.volume.api.API {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_backend_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_clear = zero {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_clear_ionice = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_clear_size = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_copy_bps_limit = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_dd_blocksize = 1M {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_name_template = volume-%s {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_service_inithost_offload = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volume_usage_audit_period = month {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] zoning_mode = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.admin_password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.admin_token = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.admin_user = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_port = 35357 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_protocol = https {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_section = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_type = password {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_uri = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.auth_version = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.cache = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.identity_uri = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.insecure = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.interface = public {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_password = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcache_username = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.region_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.service_type = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.backend = dogpile.cache.null {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.backend_argument = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.backend_expiration_time = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.config_prefix = cache.oslo {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.debug_cache_backend = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.enable_retry_client = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.enable_socket_keepalive = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.enforce_fips_mode = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.expiration_time = 600 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_dead_retry = 300 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_sasl_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.proxies = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.redis_db = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.redis_server = localhost:6379 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.retry_attempts = 2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.retry_delay = 0.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.socket_keepalive_count = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.socket_keepalive_idle = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.socket_keepalive_interval = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.socket_timeout = 1.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.tls_allowed_ciphers = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.tls_cafile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.tls_certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.tls_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.tls_keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cache.username = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] coordination.backend_url = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.asyncio_connection = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.asyncio_slave_connection = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.backend = sqlalchemy {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.connection = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.connection_debug = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.connection_parameters = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.connection_recycle_time = 3600 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.connection_trace = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.db_inc_retry_interval = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.db_max_retries = 20 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.db_max_retry_interval = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.db_retry_interval = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.max_overflow = 50 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.max_pool_size = 5 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.max_retries = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.pool_timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.retry_interval = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86522) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 04 14:41:38 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 04 14:41:38 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Running cmd (subprocess): mount.quobyte {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.slave_connection = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.sqlite_synchronous = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.synchronous_reader = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] database.use_db_reconnect = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.connection_string = messaging:// {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.es_doc_type = notification {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.es_scroll_size = 10000 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.es_scroll_time = 2m {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.filter_error_trace = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.hmac_keys = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.sentinel_service_name = mymaster {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.socket_timeout = 0.1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.trace_requests = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler.trace_sqlalchemy = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler_jaeger.process_tags = {} {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] profiler_otlp.service_name_prefix = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.enforce_new_defaults = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: WARNING oslo_config.cfg [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.enforce_scope = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.policy_default_rule = default {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.group = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.helper_command = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] privsep_osbrick.user = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.group = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.helper_command = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] cinder_sys_admin.user = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.auth_section = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.auth_type = password {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.cafile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.collect_timing = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.insecure = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.send_service_user_token = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.split_loggers = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] service_user.timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.auth_section = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.auth_type = password {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.collect_timing = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.insecure = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.region_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.split_loggers = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] glance.timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.backend_availability_zone = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.chap_password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.chap_username = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.disk_geometry = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.driver_client_cert = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.driver_data_namespace = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.driver_use_ssl = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.extra_capabilities = {} {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.filter_function = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.goodness_function = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.iscsi_target_flags = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.iser_port = 3260 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_host = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_login = admin {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_mount_options = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_private_key = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_share_path = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.replication_device = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.report_discard_supported = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.target_helper = tgtadm {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.target_port = 3260 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.target_protocol = iscsi {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.trace_flags = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.use_chap_auth = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_backend_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_clear = zero {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_reports.file_event_handler = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_reports.log_dir = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.backend_host = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.chap_password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.chap_username = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.disk_geometry = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.driver_client_cert = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.extra_capabilities = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.filter_function = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.goodness_function = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.iser_helper = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.iser_ip_address = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.iser_port = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack quobyte-client[86529]: Reading configuration file: /etc/quobyte/client.cfg Jun 04 14:41:38 devstack quobyte-client[86529]: Invalid parameters found, error: missing mount point. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_host = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack quobyte-client[86529]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_login = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_mount_options = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack quobyte-client[86529]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_password = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_private_key = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_share_path = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.num_shell_tries = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.replication_device = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.report_discard_supported = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.reserved_percentage = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.scst_target_driver = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.storage_protocol = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.target_helper = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.target_ip_address = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.target_port = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.target_prefix = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.target_protocol = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.trace_flags = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.use_chap_auth = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_clear = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_clear_size = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] QuobyteHD.volumes_dir = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_notifications.driver = [] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] key_manager.fixed_key = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.barbican_api_version = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.barbican_endpoint = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.barbican_endpoint_type = public {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.barbican_region_name = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.cafile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.collect_timing = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.insecure = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:41:38 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.number_of_retries = 60 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.retry_delay = 1 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.send_service_user_token = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.split_loggers = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.verify_ssl = True {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican.verify_ssl_path = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.auth_section = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.auth_type = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.cafile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.certfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.collect_timing = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.insecure = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.keyfile = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.split_loggers = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] barbican_service_user.timeout = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.approle_role_id = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.approle_secret_id = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.kv_mountpoint = secret {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.kv_path = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.kv_version = 2 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.namespace = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.root_token_id = **** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.ssl_ca_crt_file = None {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.timeout = 60.0 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.use_ssl = False {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 14:41:38 devstack cinder-volume[86247]: DEBUG oslo_service.backend._eventlet.service [None req-b80d4ef1-0c8c-41df-ad03-3e0fdb8e71e5 None None] ******************************************************************************** {{(pid=86247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 14:41:39 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.560s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:39 devstack cinder-volume[86522]: INFO cinder.volume.driver [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.volume.driver [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86522) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_db.sqlalchemy.engines [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86522) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writer thread running {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.db.sqlalchemy.api [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Building query based on filter {{(pid=86522) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86522) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:39 devstack cinder-volume[86522]: INFO cinder.keymgr.migration [None req-797514d8-16c7-4d0a-860c-f22636b709a1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 14:41:39 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:41:39 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:39 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.545s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:41:39 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Driver initialization completed successfully. Jun 04 14:41:39 devstack cinder-volume[86522]: INFO cinder.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Initiating service 3 cleanup Jun 04 14:41:39 devstack cinder-volume[86522]: INFO cinder.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Service 3 cleanup completed. Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.service [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Creating RPC server for service cinder-volume {{(pid=86522) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.service [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86522) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 14:41:39 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:41:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:41:39 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:41:39 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:41:40 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Jun 04 14:41:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.564s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:41:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-06171f0e-c621-41ac-a551-00c2ddc0c881 None None] Driver post RPC initialization completed successfully. Jun 04 14:41:48 devstack cinder-volume[86247]: DEBUG dbcounter [-] [86247] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86247) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:41:49 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:41:50 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Flow 'volume_create_manager' (307042eb-0141-4206-b308-fd391efb2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd245715-e3b0-4c5b-a1fa-6725bd410f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd245715-e3b0-4c5b-a1fa-6725bd410f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-322131977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc269dd-9b69-49fa-8a46-0f4ca9c93680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7265d605fa364eada3b61037b17911fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:42:56Z,use_quota=True,user_id='947d773768cd4ab0963ed05d312bdc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1d1bb-7ee6-4dae-842f-7001b1516d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1d1bb-7ee6-4dae-842f-7001b1516d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f442f0-9a73-47b1-9479-4ec0adbcf1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f442f0-9a73-47b1-9479-4ec0adbcf1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc269dd-9b69-49fa-8a46-0f4ca9c93680', 'volume_name': 'volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9925f4c3-8f56-4791-83bc-dfa2303ca464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9925f4c3-8f56-4791-83bc-dfa2303ca464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332c0f82-2d53-4b9f-a1e6-ae1ee405d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:56 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Volume 8bc269dd-9b69-49fa-8a46-0f4ca9c93680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680', 'volume_size': 1} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-322131977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc269dd-9b69-49fa-8a46-0f4ca9c93680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7265d605fa364eada3b61037b17911fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:42:56Z,use_quota=True,user_id='947d773768cd4ab0963ed05d312bdc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Creating volume 8bc269dd-9b69-49fa-8a46-0f4ca9c93680 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:42:56 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:42:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:42:56 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 1073741824 Jun 04 14:42:56 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Flow 'volume_create_manager' (d0f9fe3a-1658-40bf-9b58-1b848e19037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa050eec-f21e-40f2-bd4c-213e902db50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa050eec-f21e-40f2-bd4c-213e902db50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-353348245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2ed708-236e-4322-afca-1099af3a74e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd30f1dc6eae48ea87fd49ba60ab3b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:42:59Z,use_quota=True,user_id='a09ff8ed501240e9bc4e7927f4d423df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbeffdff-799b-4f64-830d-065436b4f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbeffdff-799b-4f64-830d-065436b4f621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f4ce31-7110-4fbb-b136-b38192f42842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f4ce31-7110-4fbb-b136-b38192f42842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd2ed708-236e-4322-afca-1099af3a74e9', 'volume_name': 'volume-bd2ed708-236e-4322-afca-1099af3a74e9', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:59 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7b2882-5da8-4802-bc23-edef775d934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7b2882-5da8-4802-bc23-edef775d934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0545df26-95f6-405f-b32e-1639f678251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:42:59 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Volume bd2ed708-236e-4322-afca-1099af3a74e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd2ed708-236e-4322-afca-1099af3a74e9', 'volume_size': 1} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 1073741824" returned: 0 in 2.928s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:42:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:42:59 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 Jun 04 14:42:59 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:01 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" returned: 0 in 1.161s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] <== create_volume: return (4287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.294s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-353348245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2ed708-236e-4322-afca-1099af3a74e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd30f1dc6eae48ea87fd49ba60ab3b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:42:59Z,use_quota=True,user_id='a09ff8ed501240e9bc4e7927f4d423df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Creating volume bd2ed708-236e-4322-afca-1099af3a74e9 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:43:01 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:01 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 1073741824 Jun 04 14:43:01 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332c0f82-2d53-4b9f-a1e6-ae1ee405d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2ae696-a44f-4f1e-a349-4eab4182cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:01 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Volume volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 (8bc269dd-9b69-49fa-8a46-0f4ca9c93680): created successfully Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2ae696-a44f-4f1e-a349-4eab4182cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Flow 'volume_create_manager' (307042eb-0141-4206-b308-fd391efb2102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-026ad24c-a322-493a-82c1-ee5acae7e700 tempest-DeleteServersTestJSON-1276613113 None] Created volume successfully. Jun 04 14:43:02 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 1073741824" returned: 0 in 1.274s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:02 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 Jun 04 14:43:02 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:03 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9" returned: 0 in 0.925s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0545df26-95f6-405f-b32e-1639f678251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd2ed708-236e-4322-afca-1099af3a74e9', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed0c00e-8498-4e32-bfe8-352e1e4210ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:03 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Volume volume-bd2ed708-236e-4322-afca-1099af3a74e9 (bd2ed708-236e-4322-afca-1099af3a74e9): created successfully Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed0c00e-8498-4e32-bfe8-352e1e4210ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Flow 'volume_create_manager' (d0f9fe3a-1658-40bf-9b58-1b848e19037a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1ce8fff0-5789-4205-873e-d9d6aac12cb6 tempest-VolumesAdminNegativeTest-1642574970 None] Created volume successfully. Jun 04 14:43:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Acquiring lock "cinder-bd2ed708-236e-4322-afca-1099af3a74e9-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:43:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "cinder-bd2ed708-236e-4322-afca-1099af3a74e9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:43:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Acquiring lock "cinder-quobyte-bd2ed708-236e-4322-afca-1099af3a74e9" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:43:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "cinder-quobyte-bd2ed708-236e-4322-afca-1099af3a74e9" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:43:04 devstack cinder-volume[86522]: INFO oslo.privsep.daemon [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyqwlklfl/privsep.sock'] Jun 04 14:43:04 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyqwlklfl/privsep.sock Jun 04 14:43:04 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:09 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:09 devstack cinder-volume[86522]: INFO oslo.privsep.daemon [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Spawned new privsep daemon via rootwrap Jun 04 14:43:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Accepted privsep connection to /tmp/tmpyqwlklfl/privsep.sock {{(pid=86522) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 04 14:43:09 devstack cinder-volume[86522]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 04 14:43:09 devstack cinder-volume[86522]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 04 14:43:09 devstack cinder-volume[86522]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 04 14:43:09 devstack cinder-volume[86522]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87871 Jun 04 14:43:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3979042-5d7d-4427-b625-a1071233cf0f]: (2,) {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:43:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb16fb2-dde8-4e0f-9c16-6d04c99f2345]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:43:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:09 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 Jun 04 14:43:09 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:10 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9" returned: 0 in 1.067s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:10 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9 Jun 04 14:43:10 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Flow 'volume_create_manager' (d223d138-b638-4f6d-ba3c-60559395bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df9682a-140e-48ae-a694-55791934edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df9682a-140e-48ae-a694-55791934edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-418450843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec50e4b3-ac06-4026-ba59-dda2e79c4831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0519b872ee047e9a22c111a1f1cd7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:43:11Z,use_quota=True,user_id='3f534dfc98464389abefb02edbf5e7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2e3f59-fd02-4e10-bc30-87ab85dc515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2e3f59-fd02-4e10-bc30-87ab85dc515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f40df45-56cb-488a-a9ed-be4d6da2a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f40df45-56cb-488a-a9ed-be4d6da2a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec50e4b3-ac06-4026-ba59-dda2e79c4831', 'volume_name': 'volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c166910-5bf3-47e7-af7d-fbacb0f1ee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c166910-5bf3-47e7-af7d-fbacb0f1ee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382b51a9-5077-49de-b4e4-16af790c60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:11 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Volume ec50e4b3-ac06-4026-ba59-dda2e79c4831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831', 'volume_size': 1} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-418450843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec50e4b3-ac06-4026-ba59-dda2e79c4831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0519b872ee047e9a22c111a1f1cd7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:43:11Z,use_quota=True,user_id='3f534dfc98464389abefb02edbf5e7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Creating volume ec50e4b3-ac06-4026-ba59-dda2e79c4831 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:43:11 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:43:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:11 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 1073741824 Jun 04 14:43:11 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:12 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bd2ed708-236e-4322-afca-1099af3a74e9" returned: 0 in 1.675s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "cinder-quobyte-bd2ed708-236e-4322-afca-1099af3a74e9" released by "delete_volume" :: held 7.613s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:43:12 devstack cinder-volume[86522]: WARNING cinder.quota [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:43:12 devstack cinder-volume[86522]: WARNING cinder.quota [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Created reservations ['66781357-0a62-489a-ad6c-10dfaf45a378', 'ced39163-9089-4534-abfd-1643e50f6b7a', '216f23ac-e981-4f9e-a415-d8c15e170036', '4b4e4df9-80dd-4a26-8b85-8f20627f8b12'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:43:12 devstack cinder-volume[86522]: WARNING py.warnings [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 04 14:43:12 devstack cinder-volume[86522]: .first() Jun 04 14:43:12 devstack cinder-volume[86522]: Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:12 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:43:12 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:14 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 1073741824" returned: 0 in 2.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:14 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 Jun 04 14:43:14 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:14 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 2.164s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:43:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Deleted volume successfully. Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d175d8ca-42ce-4e7e-91ff-8d341108b834 tempest-VolumesAdminNegativeTest-1642574970 None] Lock "cinder-bd2ed708-236e-4322-afca-1099af3a74e9-delete_volume" released by "delete_volume" :: held 10.554s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:43:15 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831" returned: 0 in 1.763s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] <== create_volume: return (4618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.626s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.243s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382b51a9-5077-49de-b4e4-16af790c60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5849543-c853-41a5-a5db-f9e6037b8b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:16 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d06e43-02e9-49e7-94eb-17cf6d7bbbe9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:43:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:16 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Volume volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 (ec50e4b3-ac06-4026-ba59-dda2e79c4831): created successfully Jun 04 14:43:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5849543-c853-41a5-a5db-f9e6037b8b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Flow 'volume_create_manager' (d223d138-b638-4f6d-ba3c-60559395bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2df1c163-14c4-425f-b20f-8656401d2ccc tempest-ServerRescueNegativeTestJSON-1550291430 None] Created volume successfully. Jun 04 14:43:16 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 Jun 04 14:43:16 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:18 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" returned: 0 in 2.024s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.141s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd236850-55a4-4684-b5b9-61bf510f85b4', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:43:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-c52c2091-db60-44ed-85fd-10f34f07ac64 req-4a898212-1758-4ad7-9d9f-8b299f89d3af tempest-DeleteServersTestJSON-1276613113 None] attachment_update completed successfully. Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:22 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:43:22 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:23 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.390s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:43:28 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=19,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:43:28 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=19,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:43:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-03e23cd7-08bf-4d36-b584-b620d8ab8553 req-f28c2ad5-b100-42b8-8718-bf9848348b36 tempest-DeleteServersTestJSON-1276613113 None] Terminate volume connection completed successfully. Jun 04 14:43:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-03e23cd7-08bf-4d36-b584-b620d8ab8553 req-f28c2ad5-b100-42b8-8718-bf9848348b36 tempest-DeleteServersTestJSON-1276613113 None] Deleting attachment cd236850-55a4-4684-b5b9-61bf510f85b4. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:43:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Acquiring lock "cinder-8bc269dd-9b69-49fa-8a46-0f4ca9c93680-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:43:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Lock "cinder-8bc269dd-9b69-49fa-8a46-0f4ca9c93680-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:43:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Acquiring lock "cinder-quobyte-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:43:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Lock "cinder-quobyte-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" acquired by "delete_volume" :: waited 0.045s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:43:37 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7664e-0df9-4cd4-8309-db4acc936ef9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:43:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:37 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 Jun 04 14:43:37 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:38 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" returned: 0 in 1.222s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:38 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680 Jun 04 14:43:38 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:39 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" returned: 0 in 0.966s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Lock "cinder-quobyte-8bc269dd-9b69-49fa-8a46-0f4ca9c93680" released by "delete_volume" :: held 2.326s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Created reservations ['21af11af-3bcd-41c3-a5b9-cb962b086402', '0bd5ee4c-493d-43f2-987b-bf6d8ffee6d7', '21838ef4-eb35-464f-9829-30771134bd33', '18287397-b8a7-4441-812c-43d5bf595c51'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:39 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:43:39 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:40 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.722s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:40 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:43:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Deleted volume successfully. Jun 04 14:43:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4544c8f0-e768-477a-b6ad-7dd854ee904e tempest-DeleteServersTestJSON-1276613113 None] Lock "cinder-8bc269dd-9b69-49fa-8a46-0f4ca9c93680-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:43:50 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:43:50 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:43:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Acquiring lock "cinder-ec50e4b3-ac06-4026-ba59-dda2e79c4831-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:43:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "cinder-ec50e4b3-ac06-4026-ba59-dda2e79c4831-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:43:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Acquiring lock "cinder-quobyte-ec50e4b3-ac06-4026-ba59-dda2e79c4831" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:43:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "cinder-quobyte-ec50e4b3-ac06-4026-ba59-dda2e79c4831" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:43:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205e905-a9fd-4db1-adaf-1caedcabd606]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:43:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:51 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 Jun 04 14:43:51 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:52 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831" returned: 0 in 1.191s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:52 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831 Jun 04 14:43:52 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:53 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ec50e4b3-ac06-4026-ba59-dda2e79c4831" returned: 0 in 1.115s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "cinder-quobyte-ec50e4b3-ac06-4026-ba59-dda2e79c4831" released by "delete_volume" :: held 2.366s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Created reservations ['43b98639-17d5-4eda-a5be-89ea98923af7', '2c4b5532-09b1-44e1-8222-4943c158c21a', '6d884305-c400-456a-87e1-bec0f6fa4cca', '8a63b2c9-2a27-41fa-b206-b606ca70a4f5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:53 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:43:53 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:54 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.212s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:54 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:43:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Deleted volume successfully. Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-194bbbc1-c39c-4b97-90da-ffe4d89261cf tempest-ServerRescueNegativeTestJSON-1550291430 None] Lock "cinder-ec50e4b3-ac06-4026-ba59-dda2e79c4831-delete_volume" released by "delete_volume" :: held 3.954s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Flow 'volume_create_manager' (e7045c44-7858-441f-a915-245f83e95138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1902f165-7ae0-4570-ae56-61cf31164d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1902f165-7ae0-4570-ae56-61cf31164d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1293838161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4606201-4d26-44d1-a4de-03fda364612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbdf5a5d64f4c77900a63efb3da1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:43:56Z,use_quota=True,user_id='9ecd7af55dc54c1cb342bd357e07148b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aaf213-3573-4ad5-9864-a6610f1967a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8aaf213-3573-4ad5-9864-a6610f1967a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4eacd0-aa3d-4269-849d-d822b986d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4eacd0-aa3d-4269-849d-d822b986d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4606201-4d26-44d1-a4de-03fda364612c', 'volume_name': 'volume-c4606201-4d26-44d1-a4de-03fda364612c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85181ba-cc87-482a-a301-4023a05b510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85181ba-cc87-482a-a301-4023a05b510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4468267b-e967-49dc-b3a8-bd9c9fb187c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:55 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Volume c4606201-4d26-44d1-a4de-03fda364612c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4606201-4d26-44d1-a4de-03fda364612c', 'volume_size': 1} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1293838161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4606201-4d26-44d1-a4de-03fda364612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbdf5a5d64f4c77900a63efb3da1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:43:56Z,use_quota=True,user_id='9ecd7af55dc54c1cb342bd357e07148b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Creating volume c4606201-4d26-44d1-a4de-03fda364612c {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:43:55 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:43:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:55 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c 1073741824 Jun 04 14:43:55 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Flow 'volume_create_manager' (e99a350d-5e86-4494-a0c3-5249aa0df896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee99d9a-923d-4a10-9cfd-b27f5d54269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee99d9a-923d-4a10-9cfd-b27f5d54269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1862392929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44b8498-2581-486b-900a-4029a3a08ff4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60d212ffc5c64c4ba06216204ae8dbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:43:57Z,use_quota=True,user_id='95bfb998686d4099add71e336acce59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e039d5b3-3764-48d3-959f-e2ec84dc4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e039d5b3-3764-48d3-959f-e2ec84dc4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8487387-f0f6-4c2b-b9af-e8d1d74e07df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8487387-f0f6-4c2b-b9af-e8d1d74e07df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44b8498-2581-486b-900a-4029a3a08ff4', 'volume_name': 'volume-b44b8498-2581-486b-900a-4029a3a08ff4', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628b7e37-6046-4c1c-9dea-6244611fa579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628b7e37-6046-4c1c-9dea-6244611fa579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69404dff-2b52-4c0c-ba17-db435253479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:56 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Volume b44b8498-2581-486b-900a-4029a3a08ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44b8498-2581-486b-900a-4029a3a08ff4', 'volume_size': 1} Jun 04 14:43:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:57 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c 1073741824" returned: 0 in 1.587s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:57 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c Jun 04 14:43:57 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:58 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c" returned: 0 in 1.027s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] <== create_volume: return (2725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.731s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1862392929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44b8498-2581-486b-900a-4029a3a08ff4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60d212ffc5c64c4ba06216204ae8dbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:43:57Z,use_quota=True,user_id='95bfb998686d4099add71e336acce59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Creating volume b44b8498-2581-486b-900a-4029a3a08ff4 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:43:58 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4468267b-e967-49dc-b3a8-bd9c9fb187c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4606201-4d26-44d1-a4de-03fda364612c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:58 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 1073741824 Jun 04 14:43:58 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81f577b-5311-44af-92e8-555d415eaae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:43:58 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Volume volume-c4606201-4d26-44d1-a4de-03fda364612c (c4606201-4d26-44d1-a4de-03fda364612c): created successfully Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81f577b-5311-44af-92e8-555d415eaae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:43:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Flow 'volume_create_manager' (e7045c44-7858-441f-a915-245f83e95138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:43:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c6929cc2-d6e7-4a38-a7e6-fea8856da2d0 tempest-TaggedAttachmentsTest-705745672 None] Created volume successfully. Jun 04 14:43:59 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Jun 04 14:43:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 1073741824" returned: 0 in 1.254s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:43:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:00 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 Jun 04 14:44:00 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:00 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4" returned: 0 in 0.899s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69404dff-2b52-4c0c-ba17-db435253479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44b8498-2581-486b-900a-4029a3a08ff4', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1499d93c-2d13-472b-86ae-ac77a1aba168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Volume volume-b44b8498-2581-486b-900a-4029a3a08ff4 (b44b8498-2581-486b-900a-4029a3a08ff4): created successfully Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1499d93c-2d13-472b-86ae-ac77a1aba168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Flow 'volume_create_manager' (e99a350d-5e86-4494-a0c3-5249aa0df896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:44:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-71a05ddc-2f55-4a1c-bcd6-dba2afacad90 req-95df4aaf-e1f3-48dc-b709-0614ef636298 tempest-VolumesGetTestJSON-1560581213 None] Created volume successfully. Jun 04 14:44:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Acquiring lock "cinder-b44b8498-2581-486b-900a-4029a3a08ff4-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:44:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Lock "cinder-b44b8498-2581-486b-900a-4029a3a08ff4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:44:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Acquiring lock "cinder-quobyte-b44b8498-2581-486b-900a-4029a3a08ff4" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:44:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Lock "cinder-quobyte-b44b8498-2581-486b-900a-4029a3a08ff4" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:44:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c51d41-d9b7-4c08-990c-2a33908bfc11]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:44:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:01 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 Jun 04 14:44:01 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:02 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4" returned: 0 in 0.880s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:02 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4 Jun 04 14:44:02 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:03 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b44b8498-2581-486b-900a-4029a3a08ff4" returned: 0 in 0.663s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Lock "cinder-quobyte-b44b8498-2581-486b-900a-4029a3a08ff4" released by "delete_volume" :: held 1.600s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG cinder.quota [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Created reservations ['315281a5-9264-4aac-87d7-7bcd715075ca', 'a65d5664-1e25-44d9-b579-f791779ff9c9', '4bcacfed-2db5-4598-b5b4-627129048564', '23fffee5-7265-44f6-81e6-1aeb611b526f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:03 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:44:03 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:04 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.158s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:04 devstack cinder-volume[86522]: DEBUG cinder.manager [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:44:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Deleted volume successfully. Jun 04 14:44:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-c239352e-4f22-4a4a-a909-48e078da7500 req-5eb9217c-de87-4195-bc01-d456826085b1 tempest-VolumesGetTestJSON-1560581213 None] Lock "cinder-b44b8498-2581-486b-900a-4029a3a08ff4-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:44:13 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:44:14 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=27,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:44:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4ed73230-22c6-40c8-8af6-a3773cb9b1d4 tempest-BackendsCapabilitiesAdminTestsJSON-2051989617 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86522) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 04 14:44:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-898c0cd6-4266-4083-bfc0-1526315b33a3 tempest-BackendsCapabilitiesAdminTestsJSON-2051989617 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86522) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:22 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:44:22 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:23 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.013s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:44:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dd7d6ee2-59ef-44bb-96db-4a66c9db2933 tempest-GroupSnapshotsV319Test-1713135707 None] Group tempest-GroupSnapshotsV319Test-Group-340524939: creating Jun 04 14:44:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dd7d6ee2-59ef-44bb-96db-4a66c9db2933 tempest-GroupSnapshotsV319Test-1713135707 None] Group tempest-GroupSnapshotsV319Test-Group-340524939: created successfully Jun 04 14:44:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dd7d6ee2-59ef-44bb-96db-4a66c9db2933 tempest-GroupSnapshotsV319Test-1713135707 None] Create group completed successfully. Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Flow 'volume_create_manager' (79973956-d9ca-433a-a306-f65e8b01a33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba1f822-3357-4980-9ab3-cdea5d2844c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba1f822-3357-4980-9ab3-cdea5d2844c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-702719907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=313df545-9f72-42a1-87c2-48b30c4cfbab,host='devstack@QuobyteHD#QuobyteHD',id=42a326d9-c577-43f8-8e50-997d42f6e039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8acee48c38154b90af95d5f37b173892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:44:31Z,use_quota=True,user_id='329c328bcc85461184cf0c1224eda186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e42fc8d9-325b-4b54-bbbd-d5f212fe5e7a),volume_type_id=e42fc8d9-325b-4b54-bbbd-d5f212fe5e7a)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3656d4d9-ba06-4367-a6de-6ae9ed10c26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3656d4d9-ba06-4367-a6de-6ae9ed10c26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8d2faf-28ac-451f-9c18-eca239e9f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8d2faf-28ac-451f-9c18-eca239e9f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a326d9-c577-43f8-8e50-997d42f6e039', 'volume_name': 'volume-42a326d9-c577-43f8-8e50-997d42f6e039', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751515c2-a909-4efb-9a99-5b510d92bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751515c2-a909-4efb-9a99-5b510d92bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614014ca-c637-4435-bef4-745b6fbcae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:31 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Volume 42a326d9-c577-43f8-8e50-997d42f6e039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a326d9-c577-43f8-8e50-997d42f6e039', 'volume_size': 1} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=313df545-9f72-42a1-87c2-48b30c4cfbab,created_at=2026-06-04T12:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-702719907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=313df545-9f72-42a1-87c2-48b30c4cfbab,host='devstack@QuobyteHD#QuobyteHD',id=42a326d9-c577-43f8-8e50-997d42f6e039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8acee48c38154b90af95d5f37b173892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:44:31Z,use_quota=True,user_id='329c328bcc85461184cf0c1224eda186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e42fc8d9-325b-4b54-bbbd-d5f212fe5e7a),volume_type_id=e42fc8d9-325b-4b54-bbbd-d5f212fe5e7a)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Creating volume 42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:44:31 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:44:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:31 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 1073741824 Jun 04 14:44:31 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:32 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 1073741824" returned: 0 in 1.244s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:32 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 Jun 04 14:44:32 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:33 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039" returned: 0 in 0.908s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614014ca-c637-4435-bef4-745b6fbcae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a326d9-c577-43f8-8e50-997d42f6e039', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e17ac3-70ca-462e-9cdb-8cef1ceb9617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:44:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Volume volume-42a326d9-c577-43f8-8e50-997d42f6e039 (42a326d9-c577-43f8-8e50-997d42f6e039): created successfully Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e17ac3-70ca-462e-9cdb-8cef1ceb9617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:44:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Flow 'volume_create_manager' (79973956-d9ca-433a-a306-f65e8b01a33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:44:33 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0b6ac77a-207a-44c7-b668-599234df9de1 tempest-GroupSnapshotsV319Test-1713135707 None] Created volume successfully. Jun 04 14:44:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] GroupSnapshot 7a78314b-1f6b-4b8f-8236-5fbe354b034d: creating. Jun 04 14:44:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Group snapshot 7a78314b-1f6b-4b8f-8236-5fbe354b034d: creating. {{(pid=86522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 04 14:44:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Creating offline snapshot 2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 of volume 42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:44:35 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafca80c-b95e-417c-8fbc-13ac04729385]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:44:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:35 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 Jun 04 14:44:35 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:36 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039" returned: 0 in 1.005s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:36 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 1G Jun 04 14:44:36 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:37 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 1G" returned: 0 in 0.823s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a326d9-c577-43f8-8e50-997d42f6e039 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:37 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a326d9-c577-43f8-8e50-997d42f6e039 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 Jun 04 14:44:37 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:37 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a326d9-c577-43f8-8e50-997d42f6e039 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" returned: 0 in 0.719s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:37 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:44:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:37 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 Jun 04 14:44:37 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:38 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" returned: 0 in 0.804s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:38 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info Jun 04 14:44:38 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:39 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info" returned: 0 in 1.001s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:39 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:44:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:39 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info Jun 04 14:44:39 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:40 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.info" returned: 0 in 1.008s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.484s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-91db6825-5c0d-428e-86de-9420f91a52a8 tempest-GroupSnapshotsV319Test-1713135707 None] group_snapshot 7a78314b-1f6b-4b8f-8236-5fbe354b034d: created successfully Jun 04 14:44:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] group_snapshot 7a78314b-1f6b-4b8f-8236-5fbe354b034d: deleting Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] group_snapshot 7a78314b-1f6b-4b8f-8236-5fbe354b034d: deleting {{(pid=86522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "cinder-quobyte-42a326d9-c577-43f8-8e50-997d42f6e039" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Lock "cinder-quobyte-42a326d9-c577-43f8-8e50-997d42f6e039" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "cinder-quobyte-2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Lock "cinder-quobyte-2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Deleting offline snapshot 2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 of volume 42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] snapshot_file for this snap is: volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[22081fba-8124-400c-8267-995d5a70496c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:44:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:42 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 Jun 04 14:44:42 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:43 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" returned: 0 in 0.774s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42a326d9-c577-43f8-8e50-997d42f6e039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:44:43 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff0853-cd73-4d59-96bd-68e4348728f2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:44:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:43 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 Jun 04 14:44:43 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:44 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039" returned: 0 in 0.770s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:44 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 Jun 04 14:44:44 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:45 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" returned: 0 in 0.886s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:45 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41 Jun 04 14:44:45 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:45 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039.2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" returned: 0 in 0.835s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Lock "cinder-quobyte-2a6e871b-5cae-4c7f-8c6b-37bdb5059c41" released by "_delete_snapshot" :: held 3.407s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:44:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Lock "cinder-quobyte-42a326d9-c577-43f8-8e50-997d42f6e039" released by "delete_snapshot" :: held 3.448s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:44:46 devstack cinder-volume[86522]: WARNING cinder.quota [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-46680632 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-46680632, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:44:46 devstack cinder-volume[86522]: WARNING cinder.quota [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-46680632 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-46680632, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:44:46 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] Created reservations ['da6c1d0e-edd4-4bb0-9e14-4394a5992552', '956b73b3-3d52-465b-8a75-c7b054b3d7ac', '3ef7da85-3eac-450b-84c2-e4292f2dbe1c', 'd3c8d2e2-c55b-4cd0-8da4-fd47369e2faf'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:44:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b0b1956a-8681-44fd-abae-4c2e41c8022b tempest-GroupSnapshotsV319Test-1713135707 None] group_snapshot 7a78314b-1f6b-4b8f-8236-5fbe354b034d: deleted successfully Jun 04 14:44:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "cinder-quobyte-42a326d9-c577-43f8-8e50-997d42f6e039" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:44:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "cinder-quobyte-42a326d9-c577-43f8-8e50-997d42f6e039" acquired by "delete_volume" :: waited 0.045s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:44:47 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49941eaf-1287-4820-a908-3972b768518b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:44:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:47 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 Jun 04 14:44:47 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:48 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039" returned: 0 in 1.063s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:48 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039 Jun 04 14:44:48 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:49 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-42a326d9-c577-43f8-8e50-997d42f6e039" returned: 0 in 0.886s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "cinder-quobyte-42a326d9-c577-43f8-8e50-997d42f6e039" released by "delete_volume" :: held 2.137s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:44:49 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Created reservations ['a902223d-8438-4803-ba16-c4c444c7983e'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:44:49 devstack cinder-volume[86522]: WARNING cinder.quota [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-46680632 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-46680632, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:44:49 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Created reservations ['dce1c392-c1bc-4f27-b629-610153c828de', 'cc9b7c74-1db8-4ab2-a4dc-29b1cd561907', '127861cb-e636-4c9d-88e5-aad65632a4cc', 'a6cf4a6b-7887-49a7-bf6a-82eb34addfae'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:50 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:44:50 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:50 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.808s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:50 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:44:50 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-60c5e2f0-44d1-496d-841e-78176f519340 tempest-GroupSnapshotsV319Test-1713135707 None] Delete group completed successfully. Jun 04 14:44:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:44:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:44:58 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8b2dc-098b-4190-b3fe-66e99cf89454]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:44:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:44:58 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c Jun 04 14:44:58 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:44:59 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Jun 04 14:44:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c" returned: 0 in 1.283s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:44:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.315s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:44:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-c4606201-4d26-44d1-a4de-03fda364612c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59293c23-dc14-4175-b85e-d56f90a9d27f', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:44:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-925b43bc-c438-451a-891b-0d4449662be4 req-4b12fe8d-53a3-44f3-9e2d-85fed3d4c1e1 tempest-TaggedAttachmentsTest-705745672 None] attachment_update completed successfully. Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Flow 'volume_create_manager' (a8f9116f-e166-4246-b593-d99fc3c6584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af648ca-ff91-4c1c-aa4e-9e9d77b50344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af648ca-ff91-4c1c-aa4e-9e9d77b50344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1590363318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7526ed6-bd07-4c8e-9659-8360f9b4bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e24459bc7ec4a4a8ee711974d5e827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:02Z,use_quota=True,user_id='02632439113842b68a6a3ff457f6688c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643bc630-b255-40d6-8c6f-a088c44e6032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643bc630-b255-40d6-8c6f-a088c44e6032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b20d3e2-51fe-4246-b2f7-7ddafeb893b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b20d3e2-51fe-4246-b2f7-7ddafeb893b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7526ed6-bd07-4c8e-9659-8360f9b4bc06', 'volume_name': 'volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df633f20-05e7-4fa2-88c7-e6db6ed26c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df633f20-05e7-4fa2-88c7-e6db6ed26c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1fe9b1-abe3-414e-b5b9-209f9ce2170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:02 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Volume e7526ed6-bd07-4c8e-9659-8360f9b4bc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06', 'volume_size': 1} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1590363318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7526ed6-bd07-4c8e-9659-8360f9b4bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e24459bc7ec4a4a8ee711974d5e827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:02Z,use_quota=True,user_id='02632439113842b68a6a3ff457f6688c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Creating volume e7526ed6-bd07-4c8e-9659-8360f9b4bc06 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:45:02 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:45:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:02 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 1073741824 Jun 04 14:45:02 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:03 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 1073741824" returned: 0 in 1.039s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:03 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 Jun 04 14:45:03 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:03 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" returned: 0 in 0.811s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1fe9b1-abe3-414e-b5b9-209f9ce2170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc0124-5abf-48f1-adfd-cfd7c0f60b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:03 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Volume volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 (e7526ed6-bd07-4c8e-9659-8360f9b4bc06): created successfully Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc0124-5abf-48f1-adfd-cfd7c0f60b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Flow 'volume_create_manager' (a8f9116f-e166-4246-b593-d99fc3c6584e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1ab3e1e1-3948-438d-88fd-c4b279c56957 tempest-ServerActionsTestOtherA-367875202 None] Created volume successfully. Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Flow 'volume_create_manager' (d8339c72-5bbb-4f64-a589-b71f13c5eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cac7ada-01ec-4380-8b76-e8a844f6afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cac7ada-01ec-4380-8b76-e8a844f6afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1151444784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2595b27-d544-4bca-b179-2ba75c19a87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f06021db20f414788ca216292376bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:05Z,use_quota=True,user_id='9a543d99153149ca9154fd1392bddd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b729fb3e-4bc3-4501-91f1-239f4307298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b729fb3e-4bc3-4501-91f1-239f4307298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2dbdb6-4089-4d39-9926-19424554eea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2dbdb6-4089-4d39-9926-19424554eea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2595b27-d544-4bca-b179-2ba75c19a87a', 'volume_name': 'volume-a2595b27-d544-4bca-b179-2ba75c19a87a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8ca430-8193-48c6-b149-44b95b8bfac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8ca430-8193-48c6-b149-44b95b8bfac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a7bddb-f524-477e-b905-42c4cde7e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Volume a2595b27-d544-4bca-b179-2ba75c19a87a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2595b27-d544-4bca-b179-2ba75c19a87a', 'volume_size': 1} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1151444784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2595b27-d544-4bca-b179-2ba75c19a87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f06021db20f414788ca216292376bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:05Z,use_quota=True,user_id='9a543d99153149ca9154fd1392bddd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Creating volume a2595b27-d544-4bca-b179-2ba75c19a87a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:45:05 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:45:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:05 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a 1073741824 Jun 04 14:45:05 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:06 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a 1073741824" returned: 0 in 0.896s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:06 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a Jun 04 14:45:06 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-59eb9fb6-231a-4a6a-b6e6-7ed14503a32d req-ecb9ae2d-b00e-4dd6-a2b1-ab54f0a95b77 tempest-TaggedAttachmentsTest-705745672 None] Terminate volume connection completed successfully. Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-59eb9fb6-231a-4a6a-b6e6-7ed14503a32d req-ecb9ae2d-b00e-4dd6-a2b1-ab54f0a95b77 tempest-TaggedAttachmentsTest-705745672 None] Deleting attachment 59293c23-dc14-4175-b85e-d56f90a9d27f. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:45:07 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a" returned: 0 in 1.197s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a7bddb-f524-477e-b905-42c4cde7e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2595b27-d544-4bca-b179-2ba75c19a87a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986fc384-a029-4064-86dc-a23e6e58e6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:07 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Volume volume-a2595b27-d544-4bca-b179-2ba75c19a87a (a2595b27-d544-4bca-b179-2ba75c19a87a): created successfully Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986fc384-a029-4064-86dc-a23e6e58e6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Flow 'volume_create_manager' (d8339c72-5bbb-4f64-a589-b71f13c5eb28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0ea8975f-cf0c-4e1f-ae02-d65a05058f86 tempest-VolumesServicesTestJSON-825930372 None] Created volume successfully. Jun 04 14:45:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Acquiring lock "cinder-a2595b27-d544-4bca-b179-2ba75c19a87a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Lock "cinder-a2595b27-d544-4bca-b179-2ba75c19a87a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Acquiring lock "cinder-quobyte-a2595b27-d544-4bca-b179-2ba75c19a87a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Lock "cinder-quobyte-a2595b27-d544-4bca-b179-2ba75c19a87a" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[119bd1e6-2afe-444a-a4dd-b49e44f44aa1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:09 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a Jun 04 14:45:09 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:10 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a" returned: 0 in 1.950s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:10 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a Jun 04 14:45:10 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:12 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2595b27-d544-4bca-b179-2ba75c19a87a" returned: 0 in 1.422s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Lock "cinder-quobyte-a2595b27-d544-4bca-b179-2ba75c19a87a" released by "delete_volume" :: held 3.448s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Created reservations ['545b9fe9-835d-48e4-903c-45e9cf156ba8', 'ccb52dbf-d05a-4a07-9189-e406e94abba2', '876c66bb-55a5-4d73-8b0a-1ac330054b1c', '842daa3f-57d0-4614-b13b-8c14acb4d2f7'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:12 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:45:12 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.303s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:14 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:45:14 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Deleted volume successfully. Jun 04 14:45:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4e77bd91-ecd3-4b45-a9c7-73c56ee0c98a tempest-VolumesServicesTestJSON-825930372 None] Lock "cinder-a2595b27-d544-4bca-b179-2ba75c19a87a-delete_volume" released by "delete_volume" :: held 5.223s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:14 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Flow 'volume_create_manager' (b3286b81-21ee-4cf6-a7ed-b478fb1ca827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b64ceb-d99b-4c3b-b660-d3a15cc65964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b64ceb-d99b-4c3b-b660-d3a15cc65964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-79489825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70aa6128-7ee3-4b57-adb9-de22f499ac0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701238e83e414704812aaf0d6456b838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:19Z,use_quota=True,user_id='021ea15f008d496dad03a79b04b4103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cbc35c-adef-4406-9e11-288ff5812930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cbc35c-adef-4406-9e11-288ff5812930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cee6b5-4226-4b05-a6b2-43960e399eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cee6b5-4226-4b05-a6b2-43960e399eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70aa6128-7ee3-4b57-adb9-de22f499ac0b', 'volume_name': 'volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e073698-382d-4900-8cad-ce2046a39028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e073698-382d-4900-8cad-ce2046a39028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b020a8d-0ce7-4488-abd5-837669bcf432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:19 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Volume 70aa6128-7ee3-4b57-adb9-de22f499ac0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b', 'volume_size': 1} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-79489825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70aa6128-7ee3-4b57-adb9-de22f499ac0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701238e83e414704812aaf0d6456b838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:19Z,use_quota=True,user_id='021ea15f008d496dad03a79b04b4103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Creating volume 70aa6128-7ee3-4b57-adb9-de22f499ac0b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:45:19 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:45:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:19 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b 1073741824 Jun 04 14:45:19 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:20 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b 1073741824" returned: 0 in 1.392s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:21 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b Jun 04 14:45:21 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:22 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b" returned: 0 in 1.023s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.517s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b020a8d-0ce7-4488-abd5-837669bcf432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e2dca3-3675-4d60-bc81-d9a48729d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:22 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Volume volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b (70aa6128-7ee3-4b57-adb9-de22f499ac0b): created successfully Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e2dca3-3675-4d60-bc81-d9a48729d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Flow 'volume_create_manager' (b3286b81-21ee-4cf6-a7ed-b478fb1ca827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d82e4bf9-5825-4092-8d9c-3b905827e38a tempest-ServersNegativeTestJSON-1196861304 None] Created volume successfully. Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:22 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:45:22 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:23 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.163s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=32,cinder:SELECT=46,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=41,cinder:UPDATE=52,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Flow 'volume_create_manager' (eb382cdf-1e63-4f03-a81c-e013c9e92e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bff7dde-7b3b-4bdf-a940-5de6ae72aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bff7dde-7b3b-4bdf-a940-5de6ae72aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1561663545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f51dd1-fd2f-43b5-bf72-f9e1d61e3142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701238e83e414704812aaf0d6456b838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:25Z,use_quota=True,user_id='021ea15f008d496dad03a79b04b4103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b42cf4-2371-4cfb-b327-d0a384ae6b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b42cf4-2371-4cfb-b327-d0a384ae6b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3929de1d-e385-412e-81ad-0f205e18caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3929de1d-e385-412e-81ad-0f205e18caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f51dd1-fd2f-43b5-bf72-f9e1d61e3142', 'volume_name': 'volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab76b1e6-45e3-40ab-84ee-7296ebca29b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab76b1e6-45e3-40ab-84ee-7296ebca29b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a8dce4-208a-44f3-82fb-971860c2124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:25 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Volume 39f51dd1-fd2f-43b5-bf72-f9e1d61e3142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142', 'volume_size': 1} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1561663545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f51dd1-fd2f-43b5-bf72-f9e1d61e3142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701238e83e414704812aaf0d6456b838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:25Z,use_quota=True,user_id='021ea15f008d496dad03a79b04b4103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Creating volume 39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:45:25 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:45:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:25 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 1073741824 Jun 04 14:45:25 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:26 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 1073741824" returned: 0 in 1.173s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:26 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 Jun 04 14:45:26 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:27 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142" returned: 0 in 0.810s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a8dce4-208a-44f3-82fb-971860c2124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81e60b9-d320-4d08-bbaf-5125755762a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:27 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Volume volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 (39f51dd1-fd2f-43b5-bf72-f9e1d61e3142): created successfully Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81e60b9-d320-4d08-bbaf-5125755762a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Flow 'volume_create_manager' (eb382cdf-1e63-4f03-a81c-e013c9e92e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3ebdfb9f-aa7a-4d49-9447-a207598b9f44 tempest-ServersNegativeTestJSON-1196861304 None] Created volume successfully. Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Flow 'volume_create_manager' (f1fa1cb7-e46a-431a-9703-f7bc8ff80157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd25bad-f23f-4444-92a3-6d99dd86e970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd25bad-f23f-4444-92a3-6d99dd86e970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1700437292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e207ad1-41a1-4c51-b4de-e0ab7fab5899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11cd5e944db94dad9bd2da8da3bf3564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:27Z,use_quota=True,user_id='fd3ffbd3fca24d3a82c7e076d74d489b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3771a681-5e96-4fc7-86f0-809c3fd3a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3771a681-5e96-4fc7-86f0-809c3fd3a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59a116a-bb62-4e7a-b726-20510dc98d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59a116a-bb62-4e7a-b726-20510dc98d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e207ad1-41a1-4c51-b4de-e0ab7fab5899', 'volume_name': 'volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1d078a-b906-4ce5-957e-d02eacdd86dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1d078a-b906-4ce5-957e-d02eacdd86dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b307c0-04fb-4643-8820-bea586f2d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:27 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Volume 1e207ad1-41a1-4c51-b4de-e0ab7fab5899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899', 'volume_size': 1} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1700437292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e207ad1-41a1-4c51-b4de-e0ab7fab5899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11cd5e944db94dad9bd2da8da3bf3564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:27Z,use_quota=True,user_id='fd3ffbd3fca24d3a82c7e076d74d489b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Creating volume 1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:45:27 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:45:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:27 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 1073741824 Jun 04 14:45:27 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "cinder-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:28 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 1073741824" returned: 0 in 1.098s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "cinder-quobyte-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-quobyte-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142" acquired by "delete_volume" :: waited 0.045s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:28 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 Jun 04 14:45:28 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64bcf49-20d0-4620-8b3a-34c9a67c26d1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:28 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 Jun 04 14:45:28 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Acquiring lock "cinder-c4606201-4d26-44d1-a4de-03fda364612c-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Lock "cinder-c4606201-4d26-44d1-a4de-03fda364612c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Acquiring lock "cinder-quobyte-c4606201-4d26-44d1-a4de-03fda364612c" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Lock "cinder-quobyte-c4606201-4d26-44d1-a4de-03fda364612c" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d12e82-1cfe-4883-a136-a2ccedbff916]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:29 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b307c0-04fb-4643-8820-bea586f2d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:29 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c Jun 04 14:45:29 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e224f520-92cf-4089-badc-cce012f32c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:29 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Volume volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 (1e207ad1-41a1-4c51-b4de-e0ab7fab5899): created successfully Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e224f520-92cf-4089-badc-cce012f32c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Flow 'volume_create_manager' (f1fa1cb7-e46a-431a-9703-f7bc8ff80157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6d1e01f5-8a39-41ce-bae2-949351fd3793 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Created volume successfully. Jun 04 14:45:29 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142" returned: 0 in 1.031s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:29 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142 Jun 04 14:45:29 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:30 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c" returned: 0 in 0.798s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:30 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c Jun 04 14:45:30 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:30 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142" returned: 0 in 0.624s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-quobyte-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142" released by "delete_volume" :: held 1.705s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Created reservations ['1021038b-ffac-4114-868e-0f9f19124875', '46ff3473-e0c0-4380-80b1-033fcae1838e', '54e2e6b9-85a1-4981-a84e-66766c1b717b', '65fdd3cc-e5ef-4616-a511-7b24bbd51a60'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:30 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:45:30 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:30 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c4606201-4d26-44d1-a4de-03fda364612c" returned: 0 in 0.663s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Lock "cinder-quobyte-c4606201-4d26-44d1-a4de-03fda364612c" released by "delete_volume" :: held 1.522s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "cinder-70aa6128-7ee3-4b57-adb9-de22f499ac0b-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-70aa6128-7ee3-4b57-adb9-de22f499ac0b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Creating offline snapshot e17fd582-c445-49f3-9519-be7e9bb79797 of volume 1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Created reservations ['2e605ff7-4820-4762-99de-f0cb72b2b8a0', '0d3ac4ae-0147-4335-99ff-6c6befde6267', 'd85e54e5-6211-4c20-8d3a-bcf455aa6adc', 'edbe5058-7d71-458e-88b5-7c3e6856c541'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc373ad6-ae9c-4082-818d-a88499c7b1a3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "cinder-quobyte-70aa6128-7ee3-4b57-adb9-de22f499ac0b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-quobyte-70aa6128-7ee3-4b57-adb9-de22f499ac0b" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a931ca1a-1c6d-4b68-8e2e-a8952e201382]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:31 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 Jun 04 14:45:31 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:31 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:45:31 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:31 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b Jun 04 14:45:31 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:31 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.973s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:45:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Deleted volume successfully. Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-36fb48d1-bd9f-43fb-b53a-09d70a751675 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-39f51dd1-fd2f-43b5-bf72-f9e1d61e3142-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:31 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.610s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:45:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Deleted volume successfully. Jun 04 14:45:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3354e617-5a53-4115-bdde-a3372661356b tempest-TaggedAttachmentsTest-705745672 None] Lock "cinder-c4606201-4d26-44d1-a4de-03fda364612c-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:32 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" returned: 0 in 1.172s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:32 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 1G Jun 04 14:45:32 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:32 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b" returned: 0 in 1.190s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:32 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b Jun 04 14:45:32 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:33 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-70aa6128-7ee3-4b57-adb9-de22f499ac0b" returned: 0 in 0.869s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-quobyte-70aa6128-7ee3-4b57-adb9-de22f499ac0b" released by "delete_volume" :: held 2.130s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Created reservations ['833c8ba2-e412-4990-bacc-ddb8069d2238', 'd8f36a99-0816-41c8-ba0c-557df33ef3b2', 'b3e1dd43-635a-4509-91e7-854e4b73f0e7', 'a05f1fa0-ed39-494e-86d3-66a9b44de0de'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:33 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:45:33 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:33 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 1G" returned: 0 in 1.285s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:33 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 Jun 04 14:45:33 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:34 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.811s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:34 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:45:34 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Deleted volume successfully. Jun 04 14:45:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af8c9d51-eabe-4a45-86d8-9bc2ea627fc5 tempest-ServersNegativeTestJSON-1196861304 None] Lock "cinder-70aa6128-7ee3-4b57-adb9-de22f499ac0b-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:34 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797" returned: 0 in 0.892s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:34 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 is being set with open permissions: ugo+rw Jun 04 14:45:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:34 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 Jun 04 14:45:34 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:35 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797" returned: 0 in 0.739s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:35 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info Jun 04 14:45:35 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:36 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:36 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info is being set with open permissions: ugo+rw Jun 04 14:45:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:36 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info Jun 04 14:45:36 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:36 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.info" returned: 0 in 0.668s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.635s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:36 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-97445633-fe1e-4550-93cc-fddd6bb21380 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Create snapshot completed successfully Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "cinder-e17fd582-c445-49f3-9519-be7e9bb79797-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-e17fd582-c445-49f3-9519-be7e9bb79797-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "cinder-quobyte-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-quobyte-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "cinder-quobyte-e17fd582-c445-49f3-9519-be7e9bb79797" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-quobyte-e17fd582-c445-49f3-9519-be7e9bb79797" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Deleting offline snapshot e17fd582-c445-49f3-9519-be7e9bb79797 of volume 1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] snapshot_file for this snap is: volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5162b826-ede6-4381-a5fe-81befeaebd54]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:38 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 Jun 04 14:45:38 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:38 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:45:38 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df54367-815a-480b-a0b6-6ee66fbdc478]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:38 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 Jun 04 14:45:38 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:39 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" returned: 0 in 0.899s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:39 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 Jun 04 14:45:39 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:40 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797" returned: 0 in 0.862s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:40 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797 Jun 04 14:45:40 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:41 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899.e17fd582-c445-49f3-9519-be7e9bb79797" returned: 0 in 0.691s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-quobyte-e17fd582-c445-49f3-9519-be7e9bb79797" released by "_delete_snapshot" :: held 3.379s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-quobyte-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" released by "delete_snapshot" :: held 3.411s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:41 devstack cinder-volume[86522]: WARNING cinder.quota [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:45:41 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Created reservations ['4cf0b853-cf92-4703-8a4a-db67dc354a97', 'f53c3471-d6a8-4149-bf29-9b7662ac22c2', 'f62dd15a-6106-4251-a64c-99519b7b4e42', 'c2d27d6a-fa3c-4379-8fbd-b695a2bdcc58'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:45:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Delete snapshot completed successfully. Jun 04 14:45:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d92991fa-7f06-47bf-92ee-2e0e48141116 tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-e17fd582-c445-49f3-9519-be7e9bb79797-delete_snapshot" released by "delete_snapshot" :: held 3.617s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "cinder-1e207ad1-41a1-4c51-b4de-e0ab7fab5899-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-1e207ad1-41a1-4c51-b4de-e0ab7fab5899-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "cinder-quobyte-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-quobyte-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a5e971-ee15-43df-86fb-1c5dc4bc6b52]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:42 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 Jun 04 14:45:42 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:43 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" returned: 0 in 0.896s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:43 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899 Jun 04 14:45:43 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:43 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" returned: 0 in 0.651s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-quobyte-1e207ad1-41a1-4c51-b4de-e0ab7fab5899" released by "delete_volume" :: held 1.619s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Created reservations ['e3de1468-3e1b-49fd-ad24-f10e0cf3c83e', '38393b2c-dbf9-42a2-b064-17c8cc6246a2', '47b0cfec-cd8d-4758-8ab4-a34b92a8bcc5', 'e19348ed-fc70-45a7-8f6d-c2d6e37fb1d5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:44 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:45:44 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:45 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.944s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:45 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:45:45 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Deleted volume successfully. Jun 04 14:45:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-437d2cca-07ee-4131-bbae-0ae2a084421c tempest-VolumeSnapshotQuotasNegativeTestJSON-708803386 None] Lock "cinder-1e207ad1-41a1-4c51-b4de-e0ab7fab5899-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Flow 'volume_create_manager' (300c351a-6940-44b5-90fd-86aa6bbe4ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdaf3a-cbc9-4ffa-a711-2988f43cb9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdaf3a-cbc9-4ffa-a711-2988f43cb9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-212784213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7892b3-f3fe-4eec-bbc2-e19443621a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e27355823d545b4ab2d337c9cdf4815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:50Z,use_quota=True,user_id='b3e6dbaf5ed7418fab5a526947bd9d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f3522f-a89d-4889-bcc5-53e97898e942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f3522f-a89d-4889-bcc5-53e97898e942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48856b78-7d27-410c-944b-2a43637feab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48856b78-7d27-410c-944b-2a43637feab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7892b3-f3fe-4eec-bbc2-e19443621a4b', 'volume_name': 'volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd75281-256a-4921-95a0-c45c83b74929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd75281-256a-4921-95a0-c45c83b74929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f9c5d-5ad9-4e09-93fa-634c2278cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Volume fb7892b3-f3fe-4eec-bbc2-e19443621a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b', 'volume_size': 1} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-212784213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7892b3-f3fe-4eec-bbc2-e19443621a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e27355823d545b4ab2d337c9cdf4815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:45:50Z,use_quota=True,user_id='b3e6dbaf5ed7418fab5a526947bd9d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Creating volume fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:45:50 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:45:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:50 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b 1073741824 Jun 04 14:45:50 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:51 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b 1073741824" returned: 0 in 1.158s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:51 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b Jun 04 14:45:51 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:52 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" returned: 0 in 0.654s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.692s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f9c5d-5ad9-4e09-93fa-634c2278cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6595dc95-2a04-45ec-9081-7e4471e30b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a70582-831f-4dbe-a5d0-82a3be3b168c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Volume volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b (fb7892b3-f3fe-4eec-bbc2-e19443621a4b): created successfully Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6595dc95-2a04-45ec-9081-7e4471e30b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Flow 'volume_create_manager' (300c351a-6940-44b5-90fd-86aa6bbe4ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:45:52 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-322156c2-de5a-4ff6-be12-197201209d22 req-78d87b77-4be4-43f4-b3be-8143643d8819 tempest-VolumesSnapshotsTestJSON-41003691 None] Created volume successfully. Jun 04 14:45:52 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 Jun 04 14:45:52 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:45:53 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" returned: 0 in 0.945s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.353s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Creating offline snapshot d7ee3ac9-224e-47fd-8781-c43abf4f4648 of volume fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d4eacc-7c74-4031-89af-3c34270fa8b4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1b4d477-7d27-4e8b-8de0-94e0a5685afb', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:45:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-f7728e26-1f4a-430a-80c6-9a03343294aa req-bf340f8d-da81-40e1-bc5c-6d6aa902baa2 tempest-ServerActionsTestOtherA-367875202 None] attachment_update completed successfully. Jun 04 14:45:53 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b Jun 04 14:45:53 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:54 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" returned: 0 in 0.924s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:54 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 1G Jun 04 14:45:54 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:55 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 1G" returned: 0 in 1.004s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:55 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 Jun 04 14:45:55 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:55 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648" returned: 0 in 0.773s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:55 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 is being set with open permissions: ugo+rw Jun 04 14:45:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:55 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 Jun 04 14:45:55 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:56 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648" returned: 0 in 0.733s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:56 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info Jun 04 14:45:56 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:57 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info" returned: 0 in 0.639s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:57 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info is being set with open permissions: ugo+rw Jun 04 14:45:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:57 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info Jun 04 14:45:57 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:45:57 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jun 04 14:45:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.info" returned: 0 in 0.683s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:45:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:45:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-f7e14955-0fc5-4cc5-a3c1-11acac13448e req-301d0ad3-0cff-46e4-aedd-d969c1d05acb tempest-VolumesSnapshotsTestJSON-41003691 None] Create snapshot completed successfully Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "cinder-d7ee3ac9-224e-47fd-8781-c43abf4f4648-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-d7ee3ac9-224e-47fd-8781-c43abf4f4648-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "cinder-quobyte-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-quobyte-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "cinder-quobyte-d7ee3ac9-224e-47fd-8781-c43abf4f4648" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-quobyte-d7ee3ac9-224e-47fd-8781-c43abf4f4648" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Deleting offline snapshot d7ee3ac9-224e-47fd-8781-c43abf4f4648 of volume fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] snapshot_file for this snap is: volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[79030661-4325-46dc-a66b-9e9c2db5d771]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:45:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:45:59 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 Jun 04 14:45:59 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:00 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648" returned: 0 in 0.889s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:00 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c43f206-5bf9-4112-8491-245b64be0052]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:00 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b Jun 04 14:46:00 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-9b427173-c5ee-42e8-b0d7-bf5168ca0e82 tempest-ServerActionsTestOtherA-367875202 None] Terminate volume connection completed successfully. Jun 04 14:46:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-9b427173-c5ee-42e8-b0d7-bf5168ca0e82 tempest-ServerActionsTestOtherA-367875202 None] Deleting attachment c1b4d477-7d27-4e8b-8de0-94e0a5685afb. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:46:01 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" returned: 0 in 1.275s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:01 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 Jun 04 14:46:01 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:02 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648" returned: 0 in 0.775s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:02 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648 Jun 04 14:46:02 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:02 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b.d7ee3ac9-224e-47fd-8781-c43abf4f4648" returned: 0 in 0.694s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-quobyte-d7ee3ac9-224e-47fd-8781-c43abf4f4648" released by "_delete_snapshot" :: held 3.766s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-quobyte-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" released by "delete_snapshot" :: held 3.791s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:02 devstack cinder-volume[86522]: DEBUG cinder.quota [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Created reservations ['d1e0cfe0-1701-4060-9d3e-8a4bff67af1c', 'f2c7e78a-d236-4658-b8c2-6ec15a9c49cf', 'e05ad65a-6cf5-4dcf-b0f8-5a7bb55f0c1e', 'caf06265-0d09-4833-a15d-56881df8e07b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Delete snapshot completed successfully. Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-8ffd398c-eaa8-4992-aea0-55f1f5de06e8 req-4e2b2cc1-fc7b-4bd7-a842-53870e12d4ed tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-d7ee3ac9-224e-47fd-8781-c43abf4f4648-delete_snapshot" released by "delete_snapshot" :: held 3.974s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "cinder-fb7892b3-f3fe-4eec-bbc2-e19443621a4b-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-fb7892b3-f3fe-4eec-bbc2-e19443621a4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "cinder-quobyte-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-quobyte-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fb5ebb-3d39-4bcf-ae62-7143d66b6bcb]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a1d51-0221-46ea-a523-271c87f31fe0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:03 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 Jun 04 14:46:03 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:04 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b Jun 04 14:46:04 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Flow 'volume_create_manager' (213ebb10-98cc-4dcc-a9bd-a813ca60df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6638a9e-3779-4fdd-a903-1aca0ea87fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6638a9e-3779-4fdd-a903-1aca0ea87fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1423243345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6741f9d-196a-4baf-9703-2d35dc0412d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a81c785232b4c7aaf941fd30bf02c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:04Z,use_quota=True,user_id='88a1d287af8c49849cc15d1f25e55c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb06e2e-3075-4870-8238-6fb05f066570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb06e2e-3075-4870-8238-6fb05f066570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b839b5a-1956-48ed-bc11-4cb82981cb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b839b5a-1956-48ed-bc11-4cb82981cb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6741f9d-196a-4baf-9703-2d35dc0412d0', 'volume_name': 'volume-e6741f9d-196a-4baf-9703-2d35dc0412d0', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5862f4d7-d8e5-4ff3-b5db-cc0ad3836b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5862f4d7-d8e5-4ff3-b5db-cc0ad3836b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450d5bae-a3e8-4a99-8f74-cc0e5fd93b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:04 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Volume e6741f9d-196a-4baf-9703-2d35dc0412d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6741f9d-196a-4baf-9703-2d35dc0412d0', 'volume_size': 1} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:04 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" returned: 0 in 0.937s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:04 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1423243345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6741f9d-196a-4baf-9703-2d35dc0412d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a81c785232b4c7aaf941fd30bf02c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:04Z,use_quota=True,user_id='88a1d287af8c49849cc15d1f25e55c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Creating volume e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:46:04 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" returned: 0 in 1.047s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:04 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 1073741824 Jun 04 14:46:04 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '279017d2-fd3a-4e29-ae65-10aa22f44ab1', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:46:04 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b Jun 04 14:46:04 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-33227c0e-06de-42e7-a34a-8bdddceb7c34 req-17d56c84-749b-43c7-b8c8-b872c47d442f tempest-ServerActionsTestOtherA-367875202 None] attachment_update completed successfully. Jun 04 14:46:05 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" returned: 0 in 0.872s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-quobyte-fb7892b3-f3fe-4eec-bbc2-e19443621a4b" released by "delete_volume" :: held 2.019s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG cinder.quota [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Created reservations ['a56b5627-cfe3-4811-86f3-db9294a47563', 'f9643a44-05a4-40e9-b07f-309c83cf3d84', '5662b260-c059-4641-ac80-eae5d5e6c256', '1a6ffa2a-c6a4-49d9-8dae-0baface1843c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:05 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:05 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:05 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 1073741824" returned: 0 in 1.195s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:06 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 Jun 04 14:46:06 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:06 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.676s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.manager [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:46:06 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Deleted volume successfully. Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-1585394a-18a4-4e27-913e-14328137f2af req-d752bc6a-a349-4702-8463-642e4dfb8de9 tempest-VolumesSnapshotsTestJSON-41003691 None] Lock "cinder-fb7892b3-f3fe-4eec-bbc2-e19443621a4b-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:06 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0" returned: 0 in 0.701s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450d5bae-a3e8-4a99-8f74-cc0e5fd93b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6741f9d-196a-4baf-9703-2d35dc0412d0', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b3d236-8887-4db6-aa45-cd74db8e206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:06 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Volume volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 (e6741f9d-196a-4baf-9703-2d35dc0412d0): created successfully Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b3d236-8887-4db6-aa45-cd74db8e206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Flow 'volume_create_manager' (213ebb10-98cc-4dcc-a9bd-a813ca60df9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:06 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4911a00c-0a16-4f76-b364-18a77a26e8af tempest-VolumesDeleteCascade-1570479068 None] Created volume successfully. Jun 04 14:46:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Creating offline snapshot d3f8ce54-c26a-44fc-ad71-f88da238d89d of volume e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:46:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[df790886-c250-4cc5-8e5a-a6aeb3271a94]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:07 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 Jun 04 14:46:07 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:08 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0" returned: 0 in 0.858s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:08 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d 1G Jun 04 14:46:08 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:09 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d 1G" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:09 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:09 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:09 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 0.678s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:09 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d is being set with open permissions: ugo+rw Jun 04 14:46:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:09 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:09 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-525985d2-edbd-4104-9b24-f4c1de00d8d1 tempest-GroupsV320Test-1257772241 None] Group tempest-GroupsV320Test-Group-1680732337: creating Jun 04 14:46:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-525985d2-edbd-4104-9b24-f4c1de00d8d1 tempest-GroupsV320Test-1257772241 None] Group tempest-GroupsV320Test-Group-1680732337: created successfully Jun 04 14:46:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-525985d2-edbd-4104-9b24-f4c1de00d8d1 tempest-GroupsV320Test-1257772241 None] Create group completed successfully. Jun 04 14:46:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 0.705s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:10 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:10 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info Jun 04 14:46:10 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:12 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info" returned: 0 in 1.324s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:12 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info is being set with open permissions: ugo+rw Jun 04 14:46:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:12 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info Jun 04 14:46:12 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:12 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Created reservations ['16839292-3404-4303-8915-46e259c70797'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:13 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:13 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:13 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.info" returned: 0 in 1.333s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.847s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5f7867d9-1439-45bf-8004-55ef577c9a12 tempest-VolumesDeleteCascade-1570479068 None] Create snapshot completed successfully Jun 04 14:46:14 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.056s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:46:14 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0251636b-7baf-41e4-931b-722f17886047 tempest-GroupsV320Test-1257772241 None] Delete group completed successfully. Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Creating offline snapshot 700467ab-930a-4000-b554-f5b6eee45018 of volume e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e896d4-8db4-4cb4-a8bf-57d5ea844c7a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:14 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:14 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:15 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 1.359s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6741f9d-196a-4baf-9703-2d35dc0412d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:15 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 1G Jun 04 14:46:15 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:17 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 1G" returned: 0 in 1.546s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:17 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 Jun 04 14:46:17 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:18 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018" returned: 0 in 0.899s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:18 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 is being set with open permissions: ugo+rw Jun 04 14:46:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:18 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 Jun 04 14:46:18 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:19 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018" returned: 0 in 1.296s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.334s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3f18264c-c4a2-43ee-a642-5825ca2db31b tempest-VolumesDeleteCascade-1570479068 None] Create snapshot completed successfully Jun 04 14:46:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-e6741f9d-196a-4baf-9703-2d35dc0412d0-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-e6741f9d-196a-4baf-9703-2d35dc0412d0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Performing cascade delete. {{(pid=86522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-700467ab-930a-4000-b554-f5b6eee45018-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-700467ab-930a-4000-b554-f5b6eee45018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-700467ab-930a-4000-b554-f5b6eee45018" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-700467ab-930a-4000-b554-f5b6eee45018" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Deleting offline snapshot 700467ab-930a-4000-b554-f5b6eee45018 of volume e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] snapshot_file for this snap is: volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb8bf19-b8be-47f8-a1c4-8672ca7acbcf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:21 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 Jun 04 14:46:21 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:21 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018" returned: 0 in 0.734s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6741f9d-196a-4baf-9703-2d35dc0412d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3196a7c-cac0-4fe7-a43d-c0ff7622f666]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:22 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:22 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:22 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:22 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:22 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 1.017s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6741f9d-196a-4baf-9703-2d35dc0412d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:23 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 Jun 04 14:46:23 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:23 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.490s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:46:24 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018" returned: 0 in 1.451s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:24 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018 Jun 04 14:46:24 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:25 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.700467ab-930a-4000-b554-f5b6eee45018" returned: 0 in 1.051s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-700467ab-930a-4000-b554-f5b6eee45018" released by "_delete_snapshot" :: held 4.398s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" released by "delete_snapshot" :: held 4.428s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=84,cinder:INSERT=18,cinder:UPDATE=66,cinder:DELETE=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=73,cinder:UPDATE=85,cinder:DELETE=6,cinder:INSERT=18 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Created reservations ['2962a771-ca8c-4341-874d-b26209a620a4', '4df19271-40da-4db6-8203-d4a8427564af', '9a0af281-71ce-4bee-a872-cf19fef86ad1', 'c5ff0aac-9ad1-47da-8b67-23efd5080921'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Delete snapshot completed successfully. Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-700467ab-930a-4000-b554-f5b6eee45018-delete_snapshot" released by "delete_snapshot" :: held 4.650s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-d3f8ce54-c26a-44fc-ad71-f88da238d89d-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-d3f8ce54-c26a-44fc-ad71-f88da238d89d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-d3f8ce54-c26a-44fc-ad71-f88da238d89d" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-d3f8ce54-c26a-44fc-ad71-f88da238d89d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Deleting offline snapshot d3f8ce54-c26a-44fc-ad71-f88da238d89d of volume e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] snapshot_file for this snap is: volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebeca9c-4828-47f7-90fe-3886ed8dde20]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:26 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:26 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:26 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 0.952s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6741f9d-196a-4baf-9703-2d35dc0412d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc3c6f-54cf-4250-92c2-e8dd8b1c630f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:27 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 Jun 04 14:46:27 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:27 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0" returned: 0 in 0.850s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:27 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:27 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:28 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:28 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d Jun 04 14:46:28 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:29 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0.d3f8ce54-c26a-44fc-ad71-f88da238d89d" returned: 0 in 0.642s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-d3f8ce54-c26a-44fc-ad71-f88da238d89d" released by "_delete_snapshot" :: held 3.247s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" released by "delete_snapshot" :: held 3.285s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Created reservations ['1617fcd3-a31f-4892-852a-28284227ba81', '462fdeac-8b29-4ad3-9482-526461d3b843', 'cf9a8fd7-97e9-47f1-b02f-1d6aeb748b8a', '6260ee73-4cd8-4b32-9b00-8a08580e4e88'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Delete snapshot completed successfully. Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-d3f8ce54-c26a-44fc-ad71-f88da238d89d-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Snapshots deleted, issuing volume delete {{(pid=86522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd39c1c-e36c-4196-bdcc-897a749d22ac]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:29 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 Jun 04 14:46:29 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:30 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0" returned: 0 in 0.738s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:30 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0 Jun 04 14:46:30 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:30 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e6741f9d-196a-4baf-9703-2d35dc0412d0" returned: 0 in 0.590s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-e6741f9d-196a-4baf-9703-2d35dc0412d0" released by "delete_volume" :: held 1.401s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Created reservations ['f95db3ee-56a8-4b61-a7a0-f56370848259', 'd03d2dd4-7255-4fc0-bd37-8fcb1c2ade7d', '9f32dfdf-1a38-4724-adc0-46ba37b09cbc', 'a9ac8858-c256-49bd-89cf-e3f5581d705d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:30 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:30 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:31 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.682s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:46:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Deleted volume successfully. Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Flow 'volume_create_manager' (6b14ae40-740f-40c5-915a-ac837a331c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a542a712-ddb6-4dbf-97a6-fc5b902f9915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a542a712-ddb6-4dbf-97a6-fc5b902f9915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1970340706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94ded37-7eed-4349-baff-acd4260c2c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a81c785232b4c7aaf941fd30bf02c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:31Z,use_quota=True,user_id='88a1d287af8c49849cc15d1f25e55c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad62755f-51a7-4185-b321-bdff1b8fcd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad62755f-51a7-4185-b321-bdff1b8fcd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065f7db4-b9c4-424f-bad1-dcb35db328d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065f7db4-b9c4-424f-bad1-dcb35db328d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94ded37-7eed-4349-baff-acd4260c2c88', 'volume_name': 'volume-b94ded37-7eed-4349-baff-acd4260c2c88', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332f7a7a-d0c0-46df-bed2-3e7061aad34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332f7a7a-d0c0-46df-bed2-3e7061aad34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d34b86b-8095-4af0-af98-23c6923ec1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:31 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Volume b94ded37-7eed-4349-baff-acd4260c2c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94ded37-7eed-4349-baff-acd4260c2c88', 'volume_size': 1} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1970340706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94ded37-7eed-4349-baff-acd4260c2c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a81c785232b4c7aaf941fd30bf02c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:31Z,use_quota=True,user_id='88a1d287af8c49849cc15d1f25e55c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Creating volume b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:46:31 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3b9ce5d-c98b-4020-bc33-1297ffd25089 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-e6741f9d-196a-4baf-9703-2d35dc0412d0-delete_volume" released by "delete_volume" :: held 10.600s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:31 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 1073741824 Jun 04 14:46:31 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:32 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 1073741824" returned: 0 in 0.784s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:32 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:32 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Flow 'volume_create_manager' (6fa55159-a974-4638-8298-c54bd16754cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e054a60b-6fec-478c-8264-47f818337671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:33 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 0.737s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e054a60b-6fec-478c-8264-47f818337671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-305648211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7742a3e-848f-4ee3-b636-572515e6e51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb28dacd2c7447396696b7e21e25790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:33Z,use_quota=True,user_id='252c9011966348aeae4840f35d6f1c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6493b04-f817-4b6c-abb6-7d6396b10866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6493b04-f817-4b6c-abb6-7d6396b10866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb600200-2db9-43ad-b2b5-8185b7823dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d34b86b-8095-4af0-af98-23c6923ec1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94ded37-7eed-4349-baff-acd4260c2c88', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e0a782-6802-4a3b-9a35-6adc95ee1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Volume volume-b94ded37-7eed-4349-baff-acd4260c2c88 (b94ded37-7eed-4349-baff-acd4260c2c88): created successfully Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e0a782-6802-4a3b-9a35-6adc95ee1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Flow 'volume_create_manager' (6b14ae40-740f-40c5-915a-ac837a331c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:33 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c7a96fb2-cb83-4e37-8c04-fbe725473ac7 tempest-VolumesDeleteCascade-1570479068 None] Created volume successfully. Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb600200-2db9-43ad-b2b5-8185b7823dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7742a3e-848f-4ee3-b636-572515e6e51d', 'volume_name': 'volume-c7742a3e-848f-4ee3-b636-572515e6e51d', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e66f517-e104-46c6-b177-9648670c59b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e66f517-e104-46c6-b177-9648670c59b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599ecc79-293c-4d61-a5c5-a7be3c6a3637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Volume c7742a3e-848f-4ee3-b636-572515e6e51d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7742a3e-848f-4ee3-b636-572515e6e51d', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Trying to clone c7742a3e-848f-4ee3-b636-572515e6e51d from image d02c254e-91bb-4869-903e-8451e5a50689 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Creating offline snapshot 9deab995-356f-4d85-bd27-9adffb55e318 of volume b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d44c42-4aab-454f-8967-a2f7a8c5ffe5]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 14:46:34 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Image download 20.69 MB at 20.69 MB/s Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[844827e9-2540-416a-90f5-b6c2286eb01a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:34 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:34 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:34 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD Jun 04 14:46:34 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:34 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 0.905s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:34 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 1G Jun 04 14:46:34 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:34 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:34 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 is fetched for user 252c9011966348aeae4840f35d6f1c1e. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 14:46:35 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aa955f-e8d5-4094-9ac7-32626dfcfd81]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:35 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD Jun 04 14:46:35 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:35 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:35 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 1G" returned: 0 in 0.928s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94ded37-7eed-4349-baff-acd4260c2c88 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:35 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94ded37-7eed-4349-baff-acd4260c2c88 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 Jun 04 14:46:35 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:36 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b94ded37-7eed-4349-baff-acd4260c2c88 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318" returned: 0 in 0.688s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:36 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 is being set with open permissions: ugo+rw Jun 04 14:46:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:36 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 Jun 04 14:46:36 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:37 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318" returned: 0 in 0.658s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:37 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info Jun 04 14:46:37 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:37 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info" returned: 0 in 0.653s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:37 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info is being set with open permissions: ugo+rw Jun 04 14:46:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:37 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info Jun 04 14:46:37 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:37 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Flow 'volume_create_manager' (7c50760c-7d5a-47e2-9eca-069006c33cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3d7897-d71d-4286-b8b4-5ca4875a6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3d7897-d71d-4286-b8b4-5ca4875a6e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1258329777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9878710d-b2bc-4cc7-b744-7e04f0a6452d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a2cf8d43164210b64a07a97be5344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:38Z,use_quota=True,user_id='441ce82a3f924f52b17a1a5c5a7a2266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498ff9c4-73f1-497a-a230-b47943b6d3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498ff9c4-73f1-497a-a230-b47943b6d3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f396a3-f20f-494f-b8fc-c999d9540d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f396a3-f20f-494f-b8fc-c999d9540d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9878710d-b2bc-4cc7-b744-7e04f0a6452d', 'volume_name': 'volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ddf9e9-3cf0-4220-a501-9c9159ad88fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ddf9e9-3cf0-4220-a501-9c9159ad88fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ec1f5f-4f62-4cd6-aa87-1b5aabc80fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:38 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Volume 9878710d-b2bc-4cc7-b744-7e04f0a6452d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d', 'volume_size': 1} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-10592e51-6f61-445f-adf0-48bb52909b63 req-51e17eb9-b893-492b-af51-6660e52e8883 tempest-ServerActionsTestOtherA-367875202 None] Terminate volume connection completed successfully. Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-10592e51-6f61-445f-adf0-48bb52909b63 req-51e17eb9-b893-492b-af51-6660e52e8883 tempest-ServerActionsTestOtherA-367875202 None] Deleting attachment 279017d2-fd3a-4e29-ae65-10aa22f44ab1. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:46:38 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.info" returned: 0 in 0.626s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.722s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-305648211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7742a3e-848f-4ee3-b636-572515e6e51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb28dacd2c7447396696b7e21e25790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:33Z,use_quota=True,user_id='252c9011966348aeae4840f35d6f1c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Creating volume c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:46:38 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:46:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:38 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d 1073741824 Jun 04 14:46:38 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1aba2cef-cd77-4cf4-b2ee-1610f776bd5f tempest-VolumesDeleteCascade-1570479068 None] Create snapshot completed successfully Jun 04 14:46:39 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d 1073741824" returned: 0 in 0.794s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:39 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:39 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Flow 'volume_create_manager' (cf835805-8488-4bf7-ad98-98f9021b0a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec830fc-4573-44e7-a1ae-99d3251a217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec830fc-4573-44e7-a1ae-99d3251a217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-847562007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a81c785232b4c7aaf941fd30bf02c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9deab995-356f-4d85-bd27-9adffb55e318,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:40Z,use_quota=True,user_id='88a1d287af8c49849cc15d1f25e55c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4171eeb9-9d2c-45ed-aa54-eb8f945ffefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4171eeb9-9d2c-45ed-aa54-eb8f945ffefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8919dd51-1a83-4355-ad91-c6a2f2b6ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8919dd51-1a83-4355-ad91-c6a2f2b6ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72', 'volume_name': 'volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72', 'volume_size': 1, 'snapshot_id': '9deab995-356f-4d85-bd27-9adffb55e318'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe34a95-b078-404f-81e4-dc7dc4ae6a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe34a95-b078-404f-81e4-dc7dc4ae6a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39deb6e5-8d98-449e-ba53-f91611377834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:39 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Volume 57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72', 'volume_size': 1, 'snapshot_id': '9deab995-356f-4d85-bd27-9adffb55e318'} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:39 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 0 in 0.627s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1258329777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9878710d-b2bc-4cc7-b744-7e04f0a6452d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a2cf8d43164210b64a07a97be5344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:46:38Z,use_quota=True,user_id='441ce82a3f924f52b17a1a5c5a7a2266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Creating volume 9878710d-b2bc-4cc7-b744-7e04f0a6452d {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:46:39 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:46:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:40 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d 1073741824 Jun 04 14:46:40 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Attempting download of d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume c7742a3e-848f-4ee3-b636-572515e6e51d. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fdc5c8-c60e-4a59-80c8-c87dc934df92]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:40 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p Jun 04 14:46:40 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:40 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p" returned: 0 in 0.807s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:40 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d 1073741824" returned: 0 in 0.923s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:40 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d Jun 04 14:46:40 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:40 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p Jun 04 14:46:40 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:41 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p" returned: 1 in 0.886s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_2_gkw63p' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[974c987f-34e5-4877-9d7d-aac2e91a9da9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:41 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d" returned: 0 in 0.899s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.068s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-9deab995-356f-4d85-bd27-9adffb55e318-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ec1f5f-4f62-4cd6-aa87-1b5aabc80fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe9b016-381c-4013-966b-6914a4545cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-9deab995-356f-4d85-bd27-9adffb55e318-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Creating volume 57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 from snapshot 9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:41 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD Jun 04 14:46:41 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Volume volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d (9878710d-b2bc-4cc7-b744-7e04f0a6452d): created successfully Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe9b016-381c-4013-966b-6914a4545cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Flow 'volume_create_manager' (7c50760c-7d5a-47e2-9eca-069006c33cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] snapshot: 9deab995-356f-4d85-bd27-9adffb55e318, volume: 57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3dd9950a-3866-4856-9f76-04c8df0b591b tempest-AttachVolumeShelveTestJSON-104748290 None] Created volume successfully. Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5fca4-a158-40a6-9d3b-6fbcc3a5804b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:42 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 Jun 04 14:46:42 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:42 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] d02c254e-91bb-4869-903e-8451e5a50689 was qcow2, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:42 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:42 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:42 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318" returned: 0 in 0.848s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b94ded37-7eed-4349-baff-acd4260c2c88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c79a08-a0d5-45bf-b900-0863050fc1b3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:43 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:43 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:43 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 1.043s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:43 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:46:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:44 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 Jun 04 14:46:44 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:45 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 0 in 2.396s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:45 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_x6z4x53udevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:46:45 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Converted 112.00 MB image at 46.71 MB/s Jun 04 14:46:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:45 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d 1G Jun 04 14:46:45 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:47 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d 1G" returned: 0 in 1.953s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:47 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c774c-763e-4017-9f18-b2edcb4deb2d]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:47 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:47 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:48 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 0 in 1.413s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:48 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:48 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:50 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 1 in 1.975s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Downloaded image d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume c7742a3e-848f-4ee3-b636-572515e6e51d successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 for user 252c9011966348aeae4840f35d6f1c1e is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Marking volume c7742a3e-848f-4ee3-b636-572515e6e51d as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Copying metadata from image d02c254e-91bb-4869-903e-8451e5a50689 to c7742a3e-848f-4ee3-b636-572515e6e51d. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Creating volume glance metadata for volume c7742a3e-848f-4ee3-b636-572515e6e51d backed by image d02c254e-91bb-4869-903e-8451e5a50689 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 14:46:50 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" returned: 0 in 6.636s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599ecc79-293c-4d61-a5c5-a7be3c6a3637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7742a3e-848f-4ee3-b636-572515e6e51d', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1077d33c-3b2c-4e35-bbd1-dc9296b12f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c37bc7-1675-4b2b-a53b-7cac78f7c9b5]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Volume volume-c7742a3e-848f-4ee3-b636-572515e6e51d (c7742a3e-848f-4ee3-b636-572515e6e51d): created successfully Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1077d33c-3b2c-4e35-bbd1-dc9296b12f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Flow 'volume_create_manager' (6fa55159-a974-4638-8298-c54bd16754cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:50 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5a15ec62-d214-4962-bff6-f51766c0c92a tempest-VolumesImageMetadata-2134052952 None] Created volume successfully. Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "cinder-e7526ed6-bd07-4c8e-9659-8360f9b4bc06-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:50 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:50 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Lock "cinder-e7526ed6-bd07-4c8e-9659-8360f9b4bc06-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "cinder-quobyte-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Lock "cinder-quobyte-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a30ec-9d2c-4a4f-bb2b-fd502c83ff71]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:51 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 Jun 04 14:46:51 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:51 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" returned: 0 in 0.714s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:51 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 1.038s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:46:51 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Converted 1024.00 MB image at 154.26 MB/s Jun 04 14:46:51 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 is being set with open permissions: ugo+rw Jun 04 14:46:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:51 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06 Jun 04 14:46:51 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:51 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 Jun 04 14:46:51 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Acquiring lock "cinder-c7742a3e-848f-4ee3-b636-572515e6e51d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Lock "cinder-c7742a3e-848f-4ee3-b636-572515e6e51d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Acquiring lock "cinder-quobyte-c7742a3e-848f-4ee3-b636-572515e6e51d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Lock "cinder-quobyte-c7742a3e-848f-4ee3-b636-572515e6e51d" acquired by "delete_volume" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:52 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89425e-0599-400d-b0b9-ee29e84383ed]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" returned: 0 in 0.882s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Lock "cinder-quobyte-e7526ed6-bd07-4c8e-9659-8360f9b4bc06" released by "delete_volume" :: held 1.646s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:52 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" returned: 0 in 0.921s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" released by "_copy_volume_from_snapshot" :: held 10.725s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-9deab995-356f-4d85-bd27-9adffb55e318-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" released by "_create_volume_from_snapshot" :: held 10.801s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.857s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Created reservations ['c37a962c-06dc-4749-910c-c3ec9339e4be', '6e379f5b-e240-4dcd-a9df-6f8fac9083d3', 'cd0704ca-30d3-474d-a66c-8f2f9692b42c', '4d97a6d2-875c-445c-9f80-1cdff0e7a321'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:52 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:52 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39deb6e5-8d98-449e-ba53-f91611377834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72', 'volume_size': 1, 'snapshot_id': '9deab995-356f-4d85-bd27-9adffb55e318'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac571d-4ad2-4fdb-b0ee-6be5a12dee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:46:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Volume volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 (57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72): created successfully Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac571d-4ad2-4fdb-b0ee-6be5a12dee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Flow 'volume_create_manager' (cf835805-8488-4bf7-ad98-98f9021b0a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:46:52 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6833a4a5-6f2a-47a6-bc24-6e0c39caecff tempest-VolumesDeleteCascade-1570479068 None] Created volume successfully. Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:52 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:52 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-b94ded37-7eed-4349-baff-acd4260c2c88-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-b94ded37-7eed-4349-baff-acd4260c2c88-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Performing cascade delete. {{(pid=86522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-9deab995-356f-4d85-bd27-9adffb55e318-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-9deab995-356f-4d85-bd27-9adffb55e318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-b94ded37-7eed-4349-baff-acd4260c2c88" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-b94ded37-7eed-4349-baff-acd4260c2c88" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-9deab995-356f-4d85-bd27-9adffb55e318" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-9deab995-356f-4d85-bd27-9adffb55e318" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Deleting offline snapshot 9deab995-356f-4d85-bd27-9adffb55e318 of volume b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] snapshot_file for this snap is: volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ee1c9a-d96b-41f3-983c-ee77d4150ab6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:53 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 Jun 04 14:46:53 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:53 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 0 in 1.172s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:53 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.958s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:46:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Deleted volume successfully. Jun 04 14:46:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf713d-f6b9-43ca-af66-c28da9300ea8 tempest-ServerActionsTestOtherA-367875202 None] Lock "cinder-e7526ed6-bd07-4c8e-9659-8360f9b4bc06-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:53 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:53 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:54 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318" returned: 0 in 0.872s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b94ded37-7eed-4349-baff-acd4260c2c88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e55ea3-4b80-446f-a67d-54b171a9e774]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:54 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:54 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:54 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 1 in 0.965s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:46:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:54 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d Jun 04 14:46:54 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:55 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 1.295s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:55 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 Jun 04 14:46:55 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:55 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c7742a3e-848f-4ee3-b636-572515e6e51d" returned: 0 in 1.202s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Lock "cinder-quobyte-c7742a3e-848f-4ee3-b636-572515e6e51d" released by "delete_volume" :: held 3.440s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Created reservations ['80062e08-5d0b-4bdc-bd44-c36d52d9e746', '290a47d9-832e-4c8a-84cc-78a81948ee02', '2624836c-971a-4ba2-b36e-58639349afc8', '84411844-1fb7-4232-bee6-9a03cd27fc42'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:56 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:56 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:56 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318" returned: 0 in 0.970s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:56 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318 Jun 04 14:46:56 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:56 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.895s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:46:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Deleted volume successfully. Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e5c74d74-c9cf-4c59-abb3-9256a501ad28 tempest-VolumesImageMetadata-2134052952 None] Lock "cinder-c7742a3e-848f-4ee3-b636-572515e6e51d-delete_volume" released by "delete_volume" :: held 4.641s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:57 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88.9deab995-356f-4d85-bd27-9adffb55e318" returned: 0 in 0.876s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-9deab995-356f-4d85-bd27-9adffb55e318" released by "_delete_snapshot" :: held 4.143s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-b94ded37-7eed-4349-baff-acd4260c2c88" released by "delete_snapshot" :: held 4.184s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Created reservations ['5fb7f62a-035b-4b60-842c-4db95cfefd77', '4acfd5b4-c232-4738-bf32-f19a2698dd38', '1a4bdcac-858e-4b12-9dd5-abe08b38795e', '2097f0ba-eba3-47a7-8927-e0f22a27e401'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Delete snapshot completed successfully. Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-9deab995-356f-4d85-bd27-9adffb55e318-delete_snapshot" released by "delete_snapshot" :: held 4.395s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Snapshots deleted, issuing volume delete {{(pid=86522) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-b94ded37-7eed-4349-baff-acd4260c2c88" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-b94ded37-7eed-4349-baff-acd4260c2c88" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[91814bc6-8bd7-401b-a41c-91ee9b845fff]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:46:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:57 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:57 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:58 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 0.804s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:58 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88 Jun 04 14:46:58 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:59 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b94ded37-7eed-4349-baff-acd4260c2c88" returned: 0 in 0.701s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-b94ded37-7eed-4349-baff-acd4260c2c88" released by "delete_volume" :: held 1.581s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Created reservations ['6b6bbe3f-8df2-4241-afb4-5f9e8c9f0153', '908727a2-d05b-406f-9dac-295981f3ca95', '5ba9bb2a-e826-4e5e-829f-0477cb471ef0', '3694802f-5a12-44c5-9583-ac4f3fd92354'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:46:59 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:46:59 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:46:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "cinder-quobyte-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c829e-52dc-4447-a80f-512642668142]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:47:00 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 Jun 04 14:47:00 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Flow 'volume_create_manager' (21d6aa2b-9c03-43ad-8c6f-7c2ee387d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a2952c-5a42-4fd3-86c5-0979f6131242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a2952c-5a42-4fd3-86c5-0979f6131242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1515204966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abfc2de-9f10-4392-ab72-f73cf89810f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8a9f612ff3483fbf20f999b3ac1425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:00Z,use_quota=True,user_id='768bf074fb0749d480078de9ee86788e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d28079d-a2c3-4eba-8f74-dd8b68db210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:00 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d28079d-a2c3-4eba-8f74-dd8b68db210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d53b51-75d9-4060-9ca8-bdc2dc0eac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d53b51-75d9-4060-9ca8-bdc2dc0eac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abfc2de-9f10-4392-ab72-f73cf89810f1', 'volume_name': 'volume-8abfc2de-9f10-4392-ab72-f73cf89810f1', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65e7cb5-3b24-451b-bbd5-41d12c387909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65e7cb5-3b24-451b-bbd5-41d12c387909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3463e9ff-6616-499f-a981-093b98b68a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Volume 8abfc2de-9f10-4392-ab72-f73cf89810f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abfc2de-9f10-4392-ab72-f73cf89810f1', 'volume_size': 1} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1515204966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abfc2de-9f10-4392-ab72-f73cf89810f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8a9f612ff3483fbf20f999b3ac1425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:00Z,use_quota=True,user_id='768bf074fb0749d480078de9ee86788e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Creating volume 8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:47:00 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.068s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Deleted volume successfully. Jun 04 14:47:00 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 1073741824 Jun 04 14:47:00 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2a5dbaf1-f298-4819-8e78-b494cf759fd9 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-b94ded37-7eed-4349-baff-acd4260c2c88-delete_volume" released by "delete_volume" :: held 7.349s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:01 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" returned: 0 in 0.976s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:01 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72 Jun 04 14:47:01 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:01 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 1073741824" returned: 0 in 1.048s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:01 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 Jun 04 14:47:01 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:01 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" returned: 0 in 0.793s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-quobyte-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72" released by "delete_volume" :: held 1.863s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:01 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Created reservations ['50af2602-4bd2-453f-a148-34c4bf926e2c', '77c097e9-66a8-44b6-b5d1-baed49b507f8', 'e2ea00b1-b83e-4d84-8374-f461eaac7b36', '3563de98-afa7-4218-bde3-3f6cfb7ca2a3'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:02 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:02 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:02 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3463e9ff-6616-499f-a981-093b98b68a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abfc2de-9f10-4392-ab72-f73cf89810f1', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3aae6a-920b-4bd8-92ec-fbfcbaf1aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:02 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Volume volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 (8abfc2de-9f10-4392-ab72-f73cf89810f1): created successfully Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3aae6a-920b-4bd8-92ec-fbfcbaf1aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Flow 'volume_create_manager' (21d6aa2b-9c03-43ad-8c6f-7c2ee387d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:02 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6925081e-5ad5-46f4-9cd3-3a4ccd61b3b7 tempest-SnapshotMetadataTestJSON-636809787 None] Created volume successfully. Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Creating offline snapshot 427e5cd9-3325-47c1-a8a8-33a7f2e6a314 of volume 8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058e3d7-13bd-41fe-8a0b-65220098bee2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:03 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 Jun 04 14:47:03 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:03 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.060s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:03 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Deleted volume successfully. Jun 04 14:47:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1cb445e3-b917-46fd-a2af-72c4fdda5717 tempest-VolumesDeleteCascade-1570479068 None] Lock "cinder-57e986ad-d2d0-4384-9c1d-d7a7dd7c0b72-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:03 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1" returned: 0 in 0.850s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:03 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 1G Jun 04 14:47:03 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:04 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 1G" returned: 0 in 0.859s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:04 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 Jun 04 14:47:04 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:05 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314" returned: 0 in 0.817s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:05 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 is being set with open permissions: ugo+rw Jun 04 14:47:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:05 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 Jun 04 14:47:05 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:06 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314" returned: 0 in 0.765s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:06 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info Jun 04 14:47:06 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:06 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info" returned: 0 in 0.653s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:06 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info is being set with open permissions: ugo+rw Jun 04 14:47:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:06 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info Jun 04 14:47:06 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:07 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.info" returned: 0 in 0.637s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.727s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.055s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ef77f-50a1-435b-8bef-e9b1c0ac85af]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5b17d874-59c7-401f-b037-50af12e70c74 tempest-SnapshotMetadataTestJSON-636809787 None] Create snapshot completed successfully Jun 04 14:47:07 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d Jun 04 14:47:07 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Flow 'volume_create_manager' (f35cfbc3-efa0-460c-b85a-dc26457893d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e085fe-bd5f-4211-bd19-237b28e05833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e085fe-bd5f-4211-bd19-237b28e05833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1175129405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcaa94a0-71ad-429d-a456-bfefc440b0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7294c834e64530bc76604ba97fdccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:08Z,use_quota=True,user_id='fff88bc201f94c41840c2b9082113bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c7685d-3586-41bb-891a-dec04bab3369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c7685d-3586-41bb-891a-dec04bab3369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62090bbf-c7d4-4a25-b661-00cdf4870a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62090bbf-c7d4-4a25-b661-00cdf4870a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcaa94a0-71ad-429d-a456-bfefc440b0c6', 'volume_name': 'volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48460f65-e000-4d36-9940-d2d95eba0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48460f65-e000-4d36-9940-d2d95eba0753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b146f36-412e-46b5-9892-3519716dc81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:08 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Volume dcaa94a0-71ad-429d-a456-bfefc440b0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6', 'volume_size': 1} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:08 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d" returned: 0 in 0.983s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1175129405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcaa94a0-71ad-429d-a456-bfefc440b0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7294c834e64530bc76604ba97fdccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:08Z,use_quota=True,user_id='fff88bc201f94c41840c2b9082113bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Creating volume dcaa94a0-71ad-429d-a456-bfefc440b0c6 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:47:08 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:08 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 1073741824 Jun 04 14:47:08 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01101a70-af31-407d-88a6-1b74e6865624', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:47:08 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-f3d1b8ff-abdf-41e7-86b5-02bb091b3be7 req-2804870d-721d-4877-9bf8-621e4d8fd52c tempest-AttachVolumeShelveTestJSON-104748290 None] attachment_update completed successfully. Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "cinder-427e5cd9-3325-47c1-a8a8-33a7f2e6a314-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-427e5cd9-3325-47c1-a8a8-33a7f2e6a314-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "cinder-quobyte-8abfc2de-9f10-4392-ab72-f73cf89810f1" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-quobyte-8abfc2de-9f10-4392-ab72-f73cf89810f1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "cinder-quobyte-427e5cd9-3325-47c1-a8a8-33a7f2e6a314" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-quobyte-427e5cd9-3325-47c1-a8a8-33a7f2e6a314" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Deleting offline snapshot 427e5cd9-3325-47c1-a8a8-33a7f2e6a314 of volume 8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] snapshot_file for this snap is: volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96b38d-0d6e-412f-a34e-956d48edb765]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:09 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 Jun 04 14:47:09 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:09 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 1073741824" returned: 0 in 0.893s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:09 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 Jun 04 14:47:09 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:10 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314" returned: 0 in 0.922s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abfc2de-9f10-4392-ab72-f73cf89810f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[64608be4-08cf-41d9-803e-fbfc9d9815b1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:10 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 Jun 04 14:47:10 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:10 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6" returned: 0 in 0.804s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b146f36-412e-46b5-9892-3519716dc81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ab153b-db37-4611-a742-89a8d271e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Volume volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 (dcaa94a0-71ad-429d-a456-bfefc440b0c6): created successfully Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ab153b-db37-4611-a742-89a8d271e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Flow 'volume_create_manager' (f35cfbc3-efa0-460c-b85a-dc26457893d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-78e10015-5deb-463f-8d83-cd96d65d9890 tempest-VolumesTransfersTest-1007378777 None] Created volume successfully. Jun 04 14:47:10 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1" returned: 0 in 0.824s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:11 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 Jun 04 14:47:11 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:11 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314" returned: 0 in 0.765s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:11 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314 Jun 04 14:47:11 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:12 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1.427e5cd9-3325-47c1-a8a8-33a7f2e6a314" returned: 0 in 0.672s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-quobyte-427e5cd9-3325-47c1-a8a8-33a7f2e6a314" released by "_delete_snapshot" :: held 3.337s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5f9d4cbe-5b44-4031-8133-1bcbb68c0e1e tempest-VolumesTransfersTest-1251177301 None] Transfer volume completed successfully. Jun 04 14:47:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-quobyte-8abfc2de-9f10-4392-ab72-f73cf89810f1" released by "delete_snapshot" :: held 3.361s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:12 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Created reservations ['9ab2c1da-5230-4a60-93f9-652b909db10a', '28ff1050-d884-4d93-a712-a8448004deac', 'c28d8fbf-6291-4726-86c0-ddd373dbbd62', '958672f3-7c7c-4d3c-a431-0d7f424f17bd'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Delete snapshot completed successfully. Jun 04 14:47:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-613f19a9-886c-48e6-b79a-86f93baed889 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-427e5cd9-3325-47c1-a8a8-33a7f2e6a314-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "cinder-8abfc2de-9f10-4392-ab72-f73cf89810f1-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-8abfc2de-9f10-4392-ab72-f73cf89810f1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "cinder-quobyte-8abfc2de-9f10-4392-ab72-f73cf89810f1" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-quobyte-8abfc2de-9f10-4392-ab72-f73cf89810f1" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Acquiring lock "cinder-dcaa94a0-71ad-429d-a456-bfefc440b0c6-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-dcaa94a0-71ad-429d-a456-bfefc440b0c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[338fac9e-833d-4c00-b7a0-6afc1b5fe7fb]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Acquiring lock "cinder-quobyte-dcaa94a0-71ad-429d-a456-bfefc440b0c6" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-quobyte-dcaa94a0-71ad-429d-a456-bfefc440b0c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2812b9d-04be-4f6e-b190-054444e55208]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:13 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 Jun 04 14:47:13 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:13 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 Jun 04 14:47:13 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:14 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1" returned: 0 in 0.997s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:14 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1 Jun 04 14:47:14 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:14 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6" returned: 0 in 0.980s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:14 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6 Jun 04 14:47:14 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:15 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8abfc2de-9f10-4392-ab72-f73cf89810f1" returned: 0 in 0.821s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-quobyte-8abfc2de-9f10-4392-ab72-f73cf89810f1" released by "delete_volume" :: held 1.932s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Created reservations ['7e1325d5-31c7-4e6a-9a90-bd6bb25e25d1', '6e4a77bb-9969-485e-94a2-f05d2ce35d2a', 'e1d021f5-0932-4cdc-9532-9e1c9e56e661', 'ad78374c-0cef-4607-bc43-bb631872321a'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:15 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dcaa94a0-71ad-429d-a456-bfefc440b0c6" returned: 0 in 0.883s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-quobyte-dcaa94a0-71ad-429d-a456-bfefc440b0c6" released by "delete_volume" :: held 1.921s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Created reservations ['5f61336a-05ef-4142-b929-fbbed6a3d122', '85c00cc0-8480-4cc4-9bc1-c382b2f70f57', 'bbde7e19-e12e-406f-93f8-2d1143c0e6a2', 'b90ef0f7-d7d8-4ce1-b91d-4a5580105953'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:15 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:15 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:16 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:16 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:16 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.096s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:16 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Deleted volume successfully. Jun 04 14:47:16 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.840s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:16 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Deleted volume successfully. Jun 04 14:47:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae975099-7cd2-4998-a313-9ec64c5d5cf0 tempest-SnapshotMetadataTestJSON-636809787 None] Lock "cinder-8abfc2de-9f10-4392-ab72-f73cf89810f1-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5edda6a3-62a4-4512-8ed0-03afa17d8047 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-dcaa94a0-71ad-429d-a456-bfefc440b0c6-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Flow 'volume_create_manager' (3a30d38c-e016-400b-9458-e24b1fc37a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296c8abe-bddb-479c-9037-cdd5e424faef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296c8abe-bddb-479c-9037-cdd5e424faef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2051505489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20db111a-b78d-4687-bef2-53a7d1b8cdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7294c834e64530bc76604ba97fdccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:17Z,use_quota=True,user_id='fff88bc201f94c41840c2b9082113bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f4d1b-46ee-4233-9fda-5e115c0dddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f4d1b-46ee-4233-9fda-5e115c0dddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b757c1-4e79-4bf3-a1d8-122d5bde92e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b757c1-4e79-4bf3-a1d8-122d5bde92e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20db111a-b78d-4687-bef2-53a7d1b8cdcb', 'volume_name': 'volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f9c62e-6f70-4331-88f0-45380e7b3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f9c62e-6f70-4331-88f0-45380e7b3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ac73df-4808-42b7-9ebc-9c0170074d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Volume 20db111a-b78d-4687-bef2-53a7d1b8cdcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb', 'volume_size': 1} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2051505489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20db111a-b78d-4687-bef2-53a7d1b8cdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7294c834e64530bc76604ba97fdccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:17Z,use_quota=True,user_id='fff88bc201f94c41840c2b9082113bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Creating volume 20db111a-b78d-4687-bef2-53a7d1b8cdcb {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:47:17 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:47:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:17 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb 1073741824 Jun 04 14:47:17 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:18 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb 1073741824" returned: 0 in 0.974s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:18 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb Jun 04 14:47:18 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:19 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb" returned: 0 in 0.714s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ac73df-4808-42b7-9ebc-9c0170074d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c1b56d-4b7f-4f19-a00e-ca022240dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:19 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Volume volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb (20db111a-b78d-4687-bef2-53a7d1b8cdcb): created successfully Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c1b56d-4b7f-4f19-a00e-ca022240dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Flow 'volume_create_manager' (3a30d38c-e016-400b-9458-e24b1fc37a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-809e99fd-c47f-442f-817f-244b511232f3 tempest-VolumesTransfersTest-1007378777 None] Created volume successfully. Jun 04 14:47:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Acquiring lock "cinder-20db111a-b78d-4687-bef2-53a7d1b8cdcb-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-20db111a-b78d-4687-bef2-53a7d1b8cdcb-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Acquiring lock "cinder-quobyte-20db111a-b78d-4687-bef2-53a7d1b8cdcb" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-quobyte-20db111a-b78d-4687-bef2-53a7d1b8cdcb" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:20 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b22da77-7fad-485e-94f4-abfd51e66b49]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:20 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb Jun 04 14:47:20 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:21 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb" returned: 0 in 1.321s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:21 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb Jun 04 14:47:22 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:22 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:22 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:22 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-20db111a-b78d-4687-bef2-53a7d1b8cdcb" returned: 0 in 0.785s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-quobyte-20db111a-b78d-4687-bef2-53a7d1b8cdcb" released by "delete_volume" :: held 2.188s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Created reservations ['ab01c2c7-473c-4f3a-a063-7ae70f2aeb83', '26a24dd2-69d2-4f89-bcb9-67a027c303f5', 'fbd07ebd-034f-48e3-98dc-861bd30e7375', '7d4a2ee9-4ffb-45d1-aee0-71b98e0a8f80'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:23 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:23 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:23 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.877s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:23 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.848s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:23 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Deleted volume successfully. Jun 04 14:47:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-806fb691-9236-43e3-bd86-ddc2f44073c2 tempest-VolumesTransfersTest-551193684 None] Lock "cinder-20db111a-b78d-4687-bef2-53a7d1b8cdcb-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=113,cinder:SELECT=106,cinder:INSERT=39,cinder:DELETE=5 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=111,cinder:DELETE=12 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Flow 'volume_create_manager' (6ab68d28-7ccf-41ed-b35d-78e750549c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dc9215-341c-4897-9c64-54941ee022f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dc9215-341c-4897-9c64-54941ee022f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1354947741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73f07db-b440-4b61-b173-b0f255e0b84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418496c5d4b41d9a8b00ea54fff7c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:33Z,use_quota=True,user_id='c8d52952f4724846a3a8eb81937d7077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e0e62c-e3e0-48ae-baee-f9593803eeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e0e62c-e3e0-48ae-baee-f9593803eeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1670e2f8-7d3e-4c4e-abbd-e0db1ef830ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1670e2f8-7d3e-4c4e-abbd-e0db1ef830ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73f07db-b440-4b61-b173-b0f255e0b84e', 'volume_name': 'volume-d73f07db-b440-4b61-b173-b0f255e0b84e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef33b46-d904-4f4b-98be-e15efda90381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef33b46-d904-4f4b-98be-e15efda90381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cdc4df-96dd-4c25-8c36-38e5d6193530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Volume d73f07db-b440-4b61-b173-b0f255e0b84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73f07db-b440-4b61-b173-b0f255e0b84e', 'volume_size': 1} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1354947741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73f07db-b440-4b61-b173-b0f255e0b84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418496c5d4b41d9a8b00ea54fff7c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:33Z,use_quota=True,user_id='c8d52952f4724846a3a8eb81937d7077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Creating volume d73f07db-b440-4b61-b173-b0f255e0b84e {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:47:33 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:47:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:33 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e 1073741824 Jun 04 14:47:33 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:34 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e 1073741824" returned: 0 in 1.079s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:34 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e Jun 04 14:47:34 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:35 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e" returned: 0 in 1.065s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cdc4df-96dd-4c25-8c36-38e5d6193530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73f07db-b440-4b61-b173-b0f255e0b84e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b30b0d-ee02-478b-8d7f-77a8831121a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:35 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Volume volume-d73f07db-b440-4b61-b173-b0f255e0b84e (d73f07db-b440-4b61-b173-b0f255e0b84e): created successfully Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b30b0d-ee02-478b-8d7f-77a8831121a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Flow 'volume_create_manager' (6ab68d28-7ccf-41ed-b35d-78e750549c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9cdc4ba9-0bca-43c5-9700-a40f4948cc27 tempest-VolumesTransfersV355Test-718237729 None] Created volume successfully. Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Flow 'volume_create_manager' (d1659a83-e470-4770-8136-13684434a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420f3045-debd-4e2e-a7fc-6f48d26247fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420f3045-debd-4e2e-a7fc-6f48d26247fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014348224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b69f2b-8b41-451c-9f27-705c7e63951a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878f950200f546d295a581ba223081b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:36Z,use_quota=True,user_id='ba9a82784bce48759244e0019af683d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec14f005-3947-44b9-a02c-53364f37dde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec14f005-3947-44b9-a02c-53364f37dde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b80bbd-ee54-4a8a-9a50-895a5bea2032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b80bbd-ee54-4a8a-9a50-895a5bea2032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b69f2b-8b41-451c-9f27-705c7e63951a', 'volume_name': 'volume-a1b69f2b-8b41-451c-9f27-705c7e63951a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd384be-0cff-461a-a228-cba8fb944f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd384be-0cff-461a-a228-cba8fb944f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5804dfd2-514e-4fca-91ac-b14620b695a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:35 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Volume a1b69f2b-8b41-451c-9f27-705c7e63951a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b69f2b-8b41-451c-9f27-705c7e63951a', 'volume_size': 1} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014348224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b69f2b-8b41-451c-9f27-705c7e63951a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878f950200f546d295a581ba223081b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:36Z,use_quota=True,user_id='ba9a82784bce48759244e0019af683d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Creating volume a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:47:35 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:47:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:36 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a 1073741824 Jun 04 14:47:36 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:37 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a 1073741824" returned: 0 in 1.574s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:37 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-cf07966c-01f6-4640-b979-35898ba42fb4 tempest-VolumesTransfersV355Test-1760226724 None] Transfer volume completed successfully. Jun 04 14:47:37 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:47:37 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:38 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 0.795s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.462s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5804dfd2-514e-4fca-91ac-b14620b695a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b69f2b-8b41-451c-9f27-705c7e63951a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5e2d57-e9e6-4099-9ef5-0496ee2161db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:38 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Volume volume-a1b69f2b-8b41-451c-9f27-705c7e63951a (a1b69f2b-8b41-451c-9f27-705c7e63951a): created successfully Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5e2d57-e9e6-4099-9ef5-0496ee2161db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Flow 'volume_create_manager' (d1659a83-e470-4770-8136-13684434a984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-50ed61d4-5910-4620-9245-f7e8414067bd tempest-VolumesActionsTest-948415470 None] Created volume successfully. Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Acquiring lock "cinder-d73f07db-b440-4b61-b173-b0f255e0b84e-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-d73f07db-b440-4b61-b173-b0f255e0b84e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Acquiring lock "cinder-quobyte-d73f07db-b440-4b61-b173-b0f255e0b84e" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-quobyte-d73f07db-b440-4b61-b173-b0f255e0b84e" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8696e8-774a-4cbc-8cc0-6f8f8d0201a1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:38 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e Jun 04 14:47:38 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:39 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e" returned: 0 in 0.768s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:39 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e Jun 04 14:47:39 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:40 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d73f07db-b440-4b61-b173-b0f255e0b84e" returned: 0 in 0.689s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-quobyte-d73f07db-b440-4b61-b173-b0f255e0b84e" released by "delete_volume" :: held 1.501s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Created reservations ['12b298c9-f703-4ca7-af71-0a3e6d285ff4', '77098b71-b753-4fdb-8971-34581e0e16f5', '334e7f3d-1826-42ad-af21-7767133d8366', 'ccfde796-960b-4763-8918-4ceba99774c4'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:40 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:40 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:41 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.787s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Deleted volume successfully. Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dac17841-7357-4824-a28c-c92c8bcba932 tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-d73f07db-b440-4b61-b173-b0f255e0b84e-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Flow 'volume_create_manager' (7be14485-10d1-4e1c-95b6-dd4c753aaeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4415d348-1a06-4a2c-ad10-54fd7625361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4415d348-1a06-4a2c-ad10-54fd7625361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1333530103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d52da3-5c4a-4d6a-afd3-12e2fc538a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418496c5d4b41d9a8b00ea54fff7c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:41Z,use_quota=True,user_id='c8d52952f4724846a3a8eb81937d7077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1729942-51eb-4b83-b53b-f79dd1bcec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1729942-51eb-4b83-b53b-f79dd1bcec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ab0c2e-9674-45d8-9e70-49f16f126ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ab0c2e-9674-45d8-9e70-49f16f126ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d52da3-5c4a-4d6a-afd3-12e2fc538a06', 'volume_name': 'volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f37d2f-df9a-49cc-b3d9-460f5d34906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f37d2f-df9a-49cc-b3d9-460f5d34906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c52e8d7-ce1a-4261-b7bb-3a6fd20f0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Volume f0d52da3-5c4a-4d6a-afd3-12e2fc538a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06', 'volume_size': 1} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1333530103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d52da3-5c4a-4d6a-afd3-12e2fc538a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418496c5d4b41d9a8b00ea54fff7c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:47:41Z,use_quota=True,user_id='c8d52952f4724846a3a8eb81937d7077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Creating volume f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:47:41 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:47:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:41 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 1073741824 Jun 04 14:47:41 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:42 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 1073741824" returned: 0 in 0.851s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:42 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 Jun 04 14:47:42 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:43 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06" returned: 0 in 0.748s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c52e8d7-ce1a-4261-b7bb-3a6fd20f0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc390044-214a-4689-af33-9e0a787ccb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:47:43 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Volume volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 (f0d52da3-5c4a-4d6a-afd3-12e2fc538a06): created successfully Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc390044-214a-4689-af33-9e0a787ccb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:47:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Flow 'volume_create_manager' (7be14485-10d1-4e1c-95b6-dd4c753aaeb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:47:43 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fcb527e3-c34e-4e6a-9d1c-81e217c1a479 tempest-VolumesTransfersV355Test-718237729 None] Created volume successfully. Jun 04 14:47:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Acquiring lock "cinder-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Acquiring lock "cinder-quobyte-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-quobyte-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06" acquired by "delete_volume" :: waited 0.054s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[11711ff4-99fd-4c76-addd-81c3ee761970]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:47:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:44 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 Jun 04 14:47:44 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:46 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06" returned: 0 in 1.789s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:46 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06 Jun 04 14:47:46 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:47 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06" returned: 0 in 1.305s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-quobyte-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06" released by "delete_volume" :: held 3.231s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:47 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Created reservations ['c1e42e29-bd12-4378-a71c-26faaad2a080', '7b7b6729-329b-4ace-9c97-0e11e4b88c5b', '43955d53-0401-4b1b-8e97-580452938789', '132ec6a0-4de5-4f8e-b9f4-003df50a026b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:47:48 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:47:48 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:47:48 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.847s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:47:48 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:47:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Deleted volume successfully. Jun 04 14:47:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89773283-d1fc-4140-b237-0214b2abb8ca tempest-VolumesTransfersV355Test-1155922641 None] Lock "cinder-f0d52da3-5c4a-4d6a-afd3-12e2fc538a06-delete_volume" released by "delete_volume" :: held 4.778s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:58 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=15,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:47:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-45240c4f-922e-4395-a738-27089d74deb9 tempest-VolumesActionsTest-948415470 None] Acquiring lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a" by "attach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-45240c4f-922e-4395-a738-27089d74deb9 tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a" acquired by "attach_volume" :: waited 0.039s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-45240c4f-922e-4395-a738-27089d74deb9 tempest-VolumesActionsTest-948415470 None] Attaching volume a1b69f2b-8b41-451c-9f27-705c7e63951a to instance fc27bca0-2548-4b93-94ec-8fd34047dd80 at mountpoint /dev/vdb on host None. Jun 04 14:47:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-45240c4f-922e-4395-a738-27089d74deb9 tempest-VolumesActionsTest-948415470 None] Attach volume completed successfully. Jun 04 14:47:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-45240c4f-922e-4395-a738-27089d74deb9 tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a" released by "attach_volume" :: held 0.207s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:47:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8a64617-44fd-4d0e-8ef7-6f0ea27e26aa tempest-VolumesActionsTest-948415470 None] Acquiring lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-detach_volume" by "detach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:47:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8a64617-44fd-4d0e-8ef7-6f0ea27e26aa tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:47:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a8a64617-44fd-4d0e-8ef7-6f0ea27e26aa tempest-VolumesActionsTest-948415470 None] Detaching volume a1b69f2b-8b41-451c-9f27-705c7e63951a from instance fc27bca0-2548-4b93-94ec-8fd34047dd80. Jun 04 14:47:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-0bbd0ada-1e59-40b5-ba8a-cd42d86f49f5 req-ca24a508-f79f-4ad5-8638-f1e8cb7ebf4e tempest-AttachVolumeShelveTestJSON-104748290 None] Terminate volume connection completed successfully. Jun 04 14:47:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-0bbd0ada-1e59-40b5-ba8a-cd42d86f49f5 req-ca24a508-f79f-4ad5-8638-f1e8cb7ebf4e tempest-AttachVolumeShelveTestJSON-104748290 None] Deleting attachment 01101a70-af31-407d-88a6-1b74e6865624. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:47:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a8a64617-44fd-4d0e-8ef7-6f0ea27e26aa tempest-VolumesActionsTest-948415470 None] Detach volume completed successfully. Jun 04 14:47:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8a64617-44fd-4d0e-8ef7-6f0ea27e26aa tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (acbc60d0-d89c-4435-b157-444773ba6384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8093c3dc-ef99-4c3e-a6f8-268974eb1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8093c3dc-ef99-4c3e-a6f8-268974eb1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-340531894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c27416-023d-4444-ac96-f1b162f40014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:06Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a39e9-6f17-4ce9-a80a-6fd6be937029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a39e9-6f17-4ce9-a80a-6fd6be937029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53fbd3-2bff-49b9-9bb6-f48900a08733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53fbd3-2bff-49b9-9bb6-f48900a08733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c27416-023d-4444-ac96-f1b162f40014', 'volume_name': 'volume-b3c27416-023d-4444-ac96-f1b162f40014', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80772d20-89fc-45c2-b2e3-7590384379b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80772d20-89fc-45c2-b2e3-7590384379b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9db3ab-77b7-4a65-b94e-745656ed89a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:06 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Volume b3c27416-023d-4444-ac96-f1b162f40014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c27416-023d-4444-ac96-f1b162f40014', 'volume_size': 1} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-340531894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c27416-023d-4444-ac96-f1b162f40014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:06Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Creating volume b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:48:06 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:48:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:06 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 1073741824 Jun 04 14:48:06 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:07 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 1073741824" returned: 0 in 1.078s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:07 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 Jun 04 14:48:07 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:08 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014" returned: 0 in 0.656s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9db3ab-77b7-4a65-b94e-745656ed89a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c27416-023d-4444-ac96-f1b162f40014', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4d10ef-3004-4e83-956c-0ecab27df2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:08 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Volume volume-b3c27416-023d-4444-ac96-f1b162f40014 (b3c27416-023d-4444-ac96-f1b162f40014): created successfully Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4d10ef-3004-4e83-956c-0ecab27df2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (acbc60d0-d89c-4435-b157-444773ba6384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:08 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-aaacf085-ca73-4f51-a463-3c0101574881 tempest-VolumesSnapshotTestJSON-726317979 None] Created volume successfully. Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Creating offline snapshot cf76ea8a-03f7-459a-b6b2-abfb38bc7efa of volume b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e2c28b-ce1e-4bb0-be10-f582f023f7d0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:09 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 Jun 04 14:48:09 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:09 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Flow 'volume_create_manager' (fe7bf392-5781-47ee-a01b-58c262ee9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5339d9d0-a943-4a1b-aa51-a9a09a143a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014" returned: 0 in 0.856s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:10 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa 1G Jun 04 14:48:10 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5339d9d0-a943-4a1b-aa51-a9a09a143a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2028380245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239f9a0c-18c2-42de-a35e-87ccbc57ca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29de292221e4fcf9352f2d0ce9a6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:10Z,use_quota=True,user_id='562a712c5aba4b1891ba82e2ee94d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a86270-7496-4f10-8f98-7c8304ce4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a86270-7496-4f10-8f98-7c8304ce4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f6e20b-be89-4d9a-99f3-c0f85f7b8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f6e20b-be89-4d9a-99f3-c0f85f7b8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239f9a0c-18c2-42de-a35e-87ccbc57ca97', 'volume_name': 'volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f777cf15-6116-4a9a-b10f-c6062771aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f777cf15-6116-4a9a-b10f-c6062771aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92decfc1-20a7-41a0-b8a3-90a3586284e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Volume 239f9a0c-18c2-42de-a35e-87ccbc57ca97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97', 'volume_size': 1} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:10 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa 1G" returned: 0 in 0.799s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c27416-023d-4444-ac96-f1b162f40014 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:10 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c27416-023d-4444-ac96-f1b162f40014 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa Jun 04 14:48:10 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:11 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c27416-023d-4444-ac96-f1b162f40014 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" returned: 0 in 0.652s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:11 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa is being set with open permissions: ugo+rw Jun 04 14:48:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:11 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa Jun 04 14:48:11 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:12 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" returned: 0 in 0.610s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:12 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info Jun 04 14:48:12 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:12 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info" returned: 0 in 0.695s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:12 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info is being set with open permissions: ugo+rw Jun 04 14:48:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:12 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info Jun 04 14:48:12 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:13 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.info" returned: 0 in 0.628s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.369s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2028380245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239f9a0c-18c2-42de-a35e-87ccbc57ca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29de292221e4fcf9352f2d0ce9a6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:10Z,use_quota=True,user_id='562a712c5aba4b1891ba82e2ee94d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Creating volume 239f9a0c-18c2-42de-a35e-87ccbc57ca97 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:48:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:48:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:13 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 1073741824 Jun 04 14:48:13 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3bf142e6-9aef-4c78-90ec-3df548736996 tempest-VolumesSnapshotTestJSON-726317979 None] Create snapshot completed successfully Jun 04 14:48:14 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 1073741824" returned: 0 in 1.074s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-cf76ea8a-03f7-459a-b6b2-abfb38bc7efa-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-cf76ea8a-03f7-459a-b6b2-abfb38bc7efa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:14 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 Jun 04 14:48:14 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-b3c27416-023d-4444-ac96-f1b162f40014" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-b3c27416-023d-4444-ac96-f1b162f40014" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Deleting offline snapshot cf76ea8a-03f7-459a-b6b2-abfb38bc7efa of volume b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] snapshot_file for this snap is: volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20e0f87-250a-40b7-9315-b3c007c58072]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:14 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa Jun 04 14:48:14 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:15 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97" returned: 0 in 0.897s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92decfc1-20a7-41a0-b8a3-90a3586284e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10209476-574a-486d-8144-96406270c8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Volume volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 (239f9a0c-18c2-42de-a35e-87ccbc57ca97): created successfully Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10209476-574a-486d-8144-96406270c8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Flow 'volume_create_manager' (fe7bf392-5781-47ee-a01b-58c262ee9131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8e3a08de-e79e-4433-887f-356da78708c7 tempest-AttachVolumeTestJSON-1281504798 None] Created volume successfully. Jun 04 14:48:15 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" returned: 0 in 1.001s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c27416-023d-4444-ac96-f1b162f40014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd0388-9465-4d8c-8c04-287ffdb2534f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:15 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 Jun 04 14:48:15 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:16 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014" returned: 0 in 0.844s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:16 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa Jun 04 14:48:16 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:17 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" returned: 0 in 0.747s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:17 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa Jun 04 14:48:17 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:18 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014.cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" returned: 0 in 0.643s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-cf76ea8a-03f7-459a-b6b2-abfb38bc7efa" released by "_delete_snapshot" :: held 3.358s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-b3c27416-023d-4444-ac96-f1b162f40014" released by "delete_snapshot" :: held 3.391s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:18 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['1adc4ffa-6512-4fc5-8cdf-6ab340e4c862', 'e8ab6743-9d59-4dcd-80b7-37190b4b7d60', '856db91a-9afc-4516-8543-5a41646fb527', '1d9ed98d-0977-44ff-b794-ac96e0ac3222'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:48:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Delete snapshot completed successfully. Jun 04 14:48:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2d40434f-4878-434b-92b6-e4f0dda8ee83 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-cf76ea8a-03f7-459a-b6b2-abfb38bc7efa-delete_snapshot" released by "delete_snapshot" :: held 3.583s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (52f33656-d29c-419a-8c56-9fbba2b6f088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1758ec98-1b42-469a-9f50-7902db3f93a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1758ec98-1b42-469a-9f50-7902db3f93a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1265739929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2cafeb-8337-4f41-91ee-3d6afb4cd533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:19Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9060ff47-820f-49e0-9b92-3e6769ee3bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9060ff47-820f-49e0-9b92-3e6769ee3bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9b54e1-0bd1-4943-baf8-e968dca4fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9b54e1-0bd1-4943-baf8-e968dca4fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2cafeb-8337-4f41-91ee-3d6afb4cd533', 'volume_name': 'volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe8a51b-6259-4ea6-99a0-9022d4d1de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe8a51b-6259-4ea6-99a0-9022d4d1de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1941361-9438-4327-bc77-95cad9ac0efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:19 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Volume bb2cafeb-8337-4f41-91ee-3d6afb4cd533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533', 'volume_size': 1} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1265739929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2cafeb-8337-4f41-91ee-3d6afb4cd533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:19Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Creating volume bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:48:19 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:19 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 1073741824 Jun 04 14:48:19 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:20 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 1073741824" returned: 0 in 0.865s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:20 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:20 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:20 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 0.621s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.488s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1941361-9438-4327-bc77-95cad9ac0efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9493f009-5b1e-484f-93db-c5346aa084bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae94e7-bd7f-4c96-92e4-ca7fdb81e669]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:21 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Volume volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 (bb2cafeb-8337-4f41-91ee-3d6afb4cd533): created successfully Jun 04 14:48:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9493f009-5b1e-484f-93db-c5346aa084bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (52f33656-d29c-419a-8c56-9fbba2b6f088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-84a1ab6d-3a80-4d92-abad-36f1a9e067c8 tempest-VolumesSnapshotTestJSON-726317979 None] Created volume successfully. Jun 04 14:48:21 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 Jun 04 14:48:21 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:22 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:48:22 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:22 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97" returned: 0 in 2.024s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.067s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.813s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Creating offline snapshot e4082586-0753-421d-a3e2-861784dd322e of volume bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c3ffc2f-f1e0-42c3-8e52-678f019d7fd2', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d52bd-f904-4b4a-87bd-d79f6d46a5cd]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:23 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-62e43931-949a-429e-96c2-c9c1a9b2e4d6 req-5e2db9f4-444d-4721-820c-e7af4552aa78 tempest-AttachVolumeTestJSON-1281504798 None] attachment_update completed successfully. Jun 04 14:48:23 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:23 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:23 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.610s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:48:24 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 1.542s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:24 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e 1G Jun 04 14:48:24 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c53f4a91-8e3d-4bf7-aac9-fa3c9ee14300 tempest-VolumesActionsTest-948415470 None] Acquiring lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a" by "attach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c53f4a91-8e3d-4bf7-aac9-fa3c9ee14300 tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a" acquired by "attach_volume" :: waited 0.047s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c53f4a91-8e3d-4bf7-aac9-fa3c9ee14300 tempest-VolumesActionsTest-948415470 None] Attaching volume a1b69f2b-8b41-451c-9f27-705c7e63951a to instance b4574fe2-f385-4fc6-b73a-65edd6c618e3 at mountpoint /dev/vdb on host None. Jun 04 14:48:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c53f4a91-8e3d-4bf7-aac9-fa3c9ee14300 tempest-VolumesActionsTest-948415470 None] Attach volume completed successfully. Jun 04 14:48:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c53f4a91-8e3d-4bf7-aac9-fa3c9ee14300 tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a" released by "attach_volume" :: held 0.123s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d35c7354-3fd2-47b7-88e1-3becbffb7bbe tempest-VolumesActionsTest-948415470 None] Acquiring lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-detach_volume" by "detach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d35c7354-3fd2-47b7-88e1-3becbffb7bbe tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d35c7354-3fd2-47b7-88e1-3becbffb7bbe tempest-VolumesActionsTest-948415470 None] Detaching volume a1b69f2b-8b41-451c-9f27-705c7e63951a from instance b4574fe2-f385-4fc6-b73a-65edd6c618e3. Jun 04 14:48:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d35c7354-3fd2-47b7-88e1-3becbffb7bbe tempest-VolumesActionsTest-948415470 None] Detach volume completed successfully. Jun 04 14:48:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d35c7354-3fd2-47b7-88e1-3becbffb7bbe tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:25 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e 1G" returned: 0 in 1.108s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:25 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e Jun 04 14:48:25 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:26 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e" returned: 0 in 0.703s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:26 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e is being set with open permissions: ugo+rw Jun 04 14:48:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:26 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e Jun 04 14:48:26 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:27 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e" returned: 0 in 0.673s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:27 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info Jun 04 14:48:27 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:27 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:27 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info is being set with open permissions: ugo+rw Jun 04 14:48:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:28 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info Jun 04 14:48:28 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:28 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.info" returned: 0 in 0.809s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.811s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-385cc1ca-ea97-4f93-bbac-b884d815404b tempest-VolumesSnapshotTestJSON-726317979 None] Create snapshot completed successfully Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (49e1887f-524b-49e9-b60b-c7d6b5571f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa7b86b-9891-4311-87f8-8ab0a1d241fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa7b86b-9891-4311-87f8-8ab0a1d241fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1548352374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c03d49-0e2d-41d6-910b-47419dfcce96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e4082586-0753-421d-a3e2-861784dd322e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:30Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb8946c-9ac6-4ab0-98fa-4beeebc84f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb8946c-9ac6-4ab0-98fa-4beeebc84f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee663e4f-f4f9-4e65-b7a5-4633b75d47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee663e4f-f4f9-4e65-b7a5-4633b75d47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05c03d49-0e2d-41d6-910b-47419dfcce96', 'volume_name': 'volume-05c03d49-0e2d-41d6-910b-47419dfcce96', 'volume_size': 2, 'snapshot_id': 'e4082586-0753-421d-a3e2-861784dd322e'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933bea0d-a2c3-4c4e-8665-2e891dc017d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933bea0d-a2c3-4c4e-8665-2e891dc017d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efbbdfd-8742-488d-b151-f912fc5d171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:30 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Volume 05c03d49-0e2d-41d6-910b-47419dfcce96: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05c03d49-0e2d-41d6-910b-47419dfcce96', 'volume_size': 2, 'snapshot_id': 'e4082586-0753-421d-a3e2-861784dd322e'} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-e4082586-0753-421d-a3e2-861784dd322e-05c03d49-0e2d-41d6-910b-47419dfcce96" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-e4082586-0753-421d-a3e2-861784dd322e-05c03d49-0e2d-41d6-910b-47419dfcce96" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Creating volume 05c03d49-0e2d-41d6-910b-47419dfcce96 from snapshot e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-05c03d49-0e2d-41d6-910b-47419dfcce96" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-05c03d49-0e2d-41d6-910b-47419dfcce96" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] snapshot: e4082586-0753-421d-a3e2-861784dd322e, volume: 05c03d49-0e2d-41d6-910b-47419dfcce96, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7452176-96a0-4da1-b6d8-d0ac15bd24df]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:31 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e Jun 04 14:48:31 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:31 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e" returned: 0 in 1.125s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:48:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:48:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:48:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc2e733-497a-4ad1-bb68-a7624fbd929f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:32 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:32 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:32 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 0.846s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:32 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:48:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:32 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 Jun 04 14:48:32 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96" returned: 0 in 7.844s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:40 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef704ebd-8835-4f7b-9bc1-96ba8bdd4a1b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:40 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=64,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:48:40 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:40 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:41 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 0.984s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:41 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533, size 1024.00 MB, duration 7.85 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:48:41 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Converted 1024.00 MB image at 130.52 MB/s Jun 04 14:48:41 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 is being set with open permissions: ugo+rw Jun 04 14:48:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:41 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 Jun 04 14:48:41 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:42 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96" returned: 0 in 0.652s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-05c03d49-0e2d-41d6-910b-47419dfcce96" released by "_copy_volume_from_snapshot" :: held 11.613s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-e4082586-0753-421d-a3e2-861784dd322e-05c03d49-0e2d-41d6-910b-47419dfcce96" released by "_create_volume_from_snapshot" :: held 11.665s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.687s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.662s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a5727-68a5-4c7a-b20c-8c5d9f826238]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efbbdfd-8742-488d-b151-f912fc5d171d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c03d49-0e2d-41d6-910b-47419dfcce96', 'volume_size': 2, 'snapshot_id': 'e4082586-0753-421d-a3e2-861784dd322e'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28115d30-7dc4-42a6-92bb-4b3b3924b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Volume volume-05c03d49-0e2d-41d6-910b-47419dfcce96 (05c03d49-0e2d-41d6-910b-47419dfcce96): created successfully Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28115d30-7dc4-42a6-92bb-4b3b3924b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (49e1887f-524b-49e9-b60b-c7d6b5571f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-96384782-7eaa-46df-8808-39f5d081ad3d tempest-VolumesSnapshotTestJSON-726317979 None] Created volume successfully. Jun 04 14:48:42 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:48:42 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:43 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 0.801s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a07d5-4925-459b-ab7a-54fb1895f96c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-05c03d49-0e2d-41d6-910b-47419dfcce96-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-05c03d49-0e2d-41d6-910b-47419dfcce96-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:43 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:48:43 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-05c03d49-0e2d-41d6-910b-47419dfcce96" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-05c03d49-0e2d-41d6-910b-47419dfcce96" acquired by "delete_volume" :: waited 0.107s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1da70af-5022-4a81-a1d0-358189f26b07]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:44 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 Jun 04 14:48:44 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:44 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 1.627s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.fcaa0ed0-a1b2-444a-ab25-a7628f3cfae1ohdezh8r.img {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:44 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.fcaa0ed0-a1b2-444a-ab25-a7628f3cfae1ohdezh8r.img Jun 04 14:48:44 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:45 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96" returned: 0 in 1.555s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:45 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96 Jun 04 14:48:45 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:46 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-05c03d49-0e2d-41d6-910b-47419dfcce96" returned: 0 in 1.092s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-05c03d49-0e2d-41d6-910b-47419dfcce96" released by "delete_volume" :: held 2.829s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['d75e1674-0763-4e6a-85c3-5d45fa11a356', 'd4221a7b-ada0-439a-a0bb-16d6be9f77cd', '534bd276-fe20-4afc-83ca-6f38d25c35fe', '0d7197a2-f9a9-47f1-872f-5dfc3c28790f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:46 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:48:46 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-e4082586-0753-421d-a3e2-861784dd322e-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-e4082586-0753-421d-a3e2-861784dd322e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-e4082586-0753-421d-a3e2-861784dd322e" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-e4082586-0753-421d-a3e2-861784dd322e" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Deleting offline snapshot e4082586-0753-421d-a3e2-861784dd322e of volume bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:48:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] snapshot_file for this snap is: volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:48:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489cc8c-de31-455c-b2dc-5d4d5e21bb5a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:48 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e Jun 04 14:48:48 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:48 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.883s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:48 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:48:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Deleted volume successfully. Jun 04 14:48:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-692d1483-4eda-416b-ab8d-0a43dd465818 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-05c03d49-0e2d-41d6-910b-47419dfcce96-delete_volume" released by "delete_volume" :: held 5.454s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:50 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e" returned: 0 in 2.663s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:48:50 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea312f7-2773-4543-906a-b3181034e529]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:50 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:50 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:52 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 1.402s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:52 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e Jun 04 14:48:52 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.fcaa0ed0-a1b2-444a-ab25-a7628f3cfae1ohdezh8r.img" returned: 0 in 7.382s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[31acd849-cb7d-47c3-8632-e780fcd7340c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:52 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:48:52 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:52 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e" returned: 0 in 0.781s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:52 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e Jun 04 14:48:52 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:53 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 1.081s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.fcaa0ed0-a1b2-444a-ab25-a7628f3cfae1ohdezh8r.img {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:48:53 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Converted 1024.00 MB image at 138.70 MB/s Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] fcaa0ed0-a1b2-444a-ab25-a7628f3cfae1 was raw, no need to convert to raw {{(pid=86522) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jun 04 14:48:53 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533.e4082586-0753-421d-a3e2-861784dd322e" returned: 0 in 0.745s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-e4082586-0753-421d-a3e2-861784dd322e" released by "_delete_snapshot" :: held 5.832s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" released by "delete_snapshot" :: held 5.907s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['085ff2f3-0375-40cd-99be-849999fc4781', '4fb959e3-63bb-4f4e-9fac-d072f39316e4', '01cae8ec-7aba-419b-bfd1-1dbe620666db', '6f940aca-97d2-4866-8c80-965dbb282f7a'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:48:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Delete snapshot completed successfully. Jun 04 14:48:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5de41afb-1f35-4a30-99cf-7fbb31d853a8 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-e4082586-0753-421d-a3e2-861784dd322e-delete_snapshot" released by "delete_snapshot" :: held 6.140s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-bb2cafeb-8337-4f41-91ee-3d6afb4cd533-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-bb2cafeb-8337-4f41-91ee-3d6afb4cd533-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:48:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:48:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[854fd283-8b87-4253-a7f2-7d6a9b858ae2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:48:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:54 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:54 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:55 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 0.828s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:55 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533 Jun 04 14:48:55 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:56 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" returned: 0 in 0.809s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-bb2cafeb-8337-4f41-91ee-3d6afb4cd533" released by "delete_volume" :: held 1.713s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['a88b3a27-21ed-428e-9704-0073d4e18dbb', 'ee5f2fc3-61cc-4499-91a7-a332c4cea60c', '3310df82-0083-4b8c-a8b5-db33e720b54d', '52ed99b1-318e-477c-b053-d73f36102efd'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:48:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:48:56 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:48:56 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:48:57 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (08059935-1138-4b7b-ab02-c857898c3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a629335-8041-455b-9b78-370f7ba8464e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.921s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a629335-8041-455b-9b78-370f7ba8464e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1288502949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b11c6a-7b96-4dd5-bbfa-204facd88c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:57Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6519aa3-7ffe-4714-a5a8-a0e5a9afc8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6519aa3-7ffe-4714-a5a8-a0e5a9afc8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25091d7-8e74-4fe0-88e3-e795da6dac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25091d7-8e74-4fe0-88e3-e795da6dac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b11c6a-7b96-4dd5-bbfa-204facd88c04', 'volume_name': 'volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fb29e7-23b4-4d53-b348-861a9b8e7968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fb29e7-23b4-4d53-b348-861a9b8e7968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31aae9e-5dd1-4ca5-9257-0e9bd63b43f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:57 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Volume 81b11c6a-7b96-4dd5-bbfa-204facd88c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04', 'volume_size': 1} Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:48:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Deleted volume successfully. Jun 04 14:48:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4be5ff2e-7613-4c20-a0db-7340d623484b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-bb2cafeb-8337-4f41-91ee-3d6afb4cd533-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=67,cinder:INSERT=17,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Flow 'volume_create_manager' (4d6b2316-eac8-42de-8f59-fdf770694495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e4c361-0e5c-4eb7-970f-a57415ec78e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e4c361-0e5c-4eb7-970f-a57415ec78e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-635028454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2439f03-a3ba-4503-8ba6-0dc2ab12fcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a2cf8d43164210b64a07a97be5344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:59Z,use_quota=True,user_id='441ce82a3f924f52b17a1a5c5a7a2266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a3ee57-ff1a-4cb2-bfb1-75ee82669555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a3ee57-ff1a-4cb2-bfb1-75ee82669555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cff475-2abd-46ed-aca0-302d6366f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cff475-2abd-46ed-aca0-302d6366f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2439f03-a3ba-4503-8ba6-0dc2ab12fcee', 'volume_name': 'volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615894be-6cb5-445e-8bd0-b2f565883e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615894be-6cb5-445e-8bd0-b2f565883e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e7726c-97a6-4aed-9c5e-4461da8cc5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:48:59 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Volume b2439f03-a3ba-4503-8ba6-0dc2ab12fcee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee', 'volume_size': 1} Jun 04 14:48:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:09 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=18,cinder:INSERT=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:49:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-fe2ea833-5dd6-49ac-9d3c-59c0b447b6c7 req-f700c57b-3262-4a7c-bf91-a125a8be54a6 tempest-AttachVolumeTestJSON-1281504798 None] Terminate volume connection completed successfully. Jun 04 14:49:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-fe2ea833-5dd6-49ac-9d3c-59c0b447b6c7 req-f700c57b-3262-4a7c-bf91-a125a8be54a6 tempest-AttachVolumeTestJSON-1281504798 None] Deleting attachment 8c3ffc2f-f1e0-42c3-8e52-678f019d7fd2. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.866s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Uploaded volume to glance image-id: fcaa0ed0-a1b2-444a-ab25-a7628f3cfae1. {{(pid=86522) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.786s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1288502949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b11c6a-7b96-4dd5-bbfa-204facd88c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:57Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Creating volume 81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:49:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:49:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:13 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 1073741824 Jun 04 14:49:13 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8afa431c-a979-4f20-b180-9a9798ac9479 tempest-VolumesActionsTest-948415470 None] Copy volume to image completed successfully. Jun 04 14:49:14 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 1073741824" returned: 0 in 1.093s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:14 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:14 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:15 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 0.683s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.624s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-635028454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2439f03-a3ba-4503-8ba6-0dc2ab12fcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a2cf8d43164210b64a07a97be5344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:48:59Z,use_quota=True,user_id='441ce82a3f924f52b17a1a5c5a7a2266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Creating volume b2439f03-a3ba-4503-8ba6-0dc2ab12fcee {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:49:15 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:15 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee 1073741824 Jun 04 14:49:15 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31aae9e-5dd1-4ca5-9257-0e9bd63b43f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f5b29c-bf70-4510-b5c2-ea364975b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Volume volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 (81b11c6a-7b96-4dd5-bbfa-204facd88c04): created successfully Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f5b29c-bf70-4510-b5c2-ea364975b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (08059935-1138-4b7b-ab02-c857898c3171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9c6c747c-9061-41b2-b074-4f6090a87843 tempest-VolumesSnapshotTestJSON-726317979 None] Created volume successfully. Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:15 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee 1073741824" returned: 0 in 0.779s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:15 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee Jun 04 14:49:15 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:16 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee" returned: 0 in 0.623s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.778s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e7726c-97a6-4aed-9c5e-4461da8cc5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7893fd-3fec-412c-b995-c742d892f473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41fe15a-8b7f-4ab8-a47c-79a4006d18cf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:16 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Volume volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee (b2439f03-a3ba-4503-8ba6-0dc2ab12fcee): created successfully Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7893fd-3fec-412c-b995-c742d892f473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Flow 'volume_create_manager' (4d6b2316-eac8-42de-8f59-fdf770694495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-99cf76c1-3188-45a3-9e82-4229012a7aff tempest-AttachVolumeShelveTestJSON-104748290 None] Created volume successfully. Jun 04 14:49:16 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:49:16 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:17 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 0.719s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bdbc60-fdbd-4228-b277-5306cff3288a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:17 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:49:17 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:18 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 0.782s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:18 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img Jun 04 14:49:18 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:22 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:49:22 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:23 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.371s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:49:23 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img" returned: 0 in 5.817s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90d7c4-467a-4a73-b0b8-60eb5735073c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:24 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:49:24 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:25 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 1.604s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:25 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:49:25 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Converted 1024.00 MB image at 175.99 MB/s Jun 04 14:49:25 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] e04d9e4d-5d37-4243-858c-10299ccb8d3b was raw, converting to qcow2 {{(pid=86522) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jun 04 14:49:25 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae277449-4d97-4832-84bf-04ada5e959fb]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:25 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img Jun 04 14:49:25 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:26 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img" returned: 0 in 0.724s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:26 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img Jun 04 14:49:26 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:27 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img" returned: 1 in 0.983s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:49:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img /opt/stack/data/cinder/conversion/vol_upload_50u8a31s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:27 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img /opt/stack/data/cinder/conversion/vol_upload_50u8a31s Jun 04 14:49:27 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:28 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img /opt/stack/data/cinder/conversion/vol_upload_50u8a31s" returned: 0 in 0.851s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:28 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Image conversion details: src /opt/stack/data/cinder/conversion/a1b69f2b-8b41-451c-9f27-705c7e63951a.temp_image.e04d9e4d-5d37-4243-858c-10299ccb8d3ba4ebgiig.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_50u8a31s {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:49:28 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 04 14:49:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc17489-40f1-446e-b581-078d654efada]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_50u8a31s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:28 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_50u8a31s Jun 04 14:49:28 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:28 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_50u8a31s" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.767s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Uploaded volume to glance image-id: e04d9e4d-5d37-4243-858c-10299ccb8d3b. {{(pid=86522) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 04 14:49:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.708s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Creating offline snapshot 5b62c300-c155-4c0e-9dfd-5a807748681e of volume 81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:49:30 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4ebdd533-926c-4daa-81c8-0744f54481e0 tempest-VolumesActionsTest-948415470 None] Copy volume to image completed successfully. Jun 04 14:49:30 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06af91-4b49-482d-8aba-23f17ed27639]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:30 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:30 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:31 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 0.948s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:31 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e 1G Jun 04 14:49:31 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Acquiring lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Acquiring lock "cinder-quobyte-a1b69f2b-8b41-451c-9f27-705c7e63951a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Lock "cinder-quobyte-a1b69f2b-8b41-451c-9f27-705c7e63951a" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b931412-6ca8-46c1-a8f3-6bf694ac4684]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:32 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:49:32 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:32 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e 1G" returned: 0 in 1.139s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:32 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e Jun 04 14:49:32 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:32 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 1.154s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:32 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a Jun 04 14:49:32 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:33 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e" returned: 0 in 1.011s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:33 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e is being set with open permissions: ugo+rw Jun 04 14:49:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:33 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e Jun 04 14:49:33 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:33 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a1b69f2b-8b41-451c-9f27-705c7e63951a" returned: 0 in 0.852s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Lock "cinder-quobyte-a1b69f2b-8b41-451c-9f27-705c7e63951a" released by "delete_volume" :: held 2.067s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:33 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Created reservations ['8650994e-477b-495c-9921-6a6cb69d4f41', '037d12fd-a412-4d50-8b3b-f0d846f6487b', '36185a53-aaf2-48b4-aee5-4ac818787a2d', '9edf1ed8-51e9-4118-ab7f-dc72dd8c416e'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:34 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:49:34 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:34 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e" returned: 0 in 0.809s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:34 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info Jun 04 14:49:34 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-17e11e2e-1f41-42c3-b5be-b4aed809279a req-cb09c494-aa5f-458a-b1c6-00dc523326ed tempest-AttachVolumeShelveTestJSON-104748290 None] No connector for attachment e3fa6f28-fdd9-4586-882d-027605ec8557; skipping storage backend terminate_connection call. {{(pid=86522) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-17e11e2e-1f41-42c3-b5be-b4aed809279a req-cb09c494-aa5f-458a-b1c6-00dc523326ed tempest-AttachVolumeShelveTestJSON-104748290 None] Deleting attachment e3fa6f28-fdd9-4586-882d-027605ec8557. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:49:34 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.825s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:49:34 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Deleted volume successfully. Jun 04 14:49:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ccb20e3-58eb-4275-b1e5-7a0a87b80282 tempest-VolumesActionsTest-948415470 None] Lock "cinder-a1b69f2b-8b41-451c-9f27-705c7e63951a-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:35 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info" returned: 0 in 0.860s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:35 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info is being set with open permissions: ugo+rw Jun 04 14:49:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:35 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info Jun 04 14:49:35 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:36 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.info" returned: 0 in 0.939s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.834s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:36 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fb7c9ac2-c147-404f-9800-45b13398194b tempest-VolumesSnapshotTestJSON-726317979 None] Create snapshot completed successfully Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (b13252d9-ff2a-4ff4-937f-1755255521e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5f1aa1-fd88-4470-adb0-be694fdddb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5f1aa1-fd88-4470-adb0-be694fdddb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1548639024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869c26ba-3c90-485c-ab6f-1bfd248d8837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640a5af412264aa98e0114cd60a89129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b62c300-c155-4c0e-9dfd-5a807748681e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:49:38Z,use_quota=True,user_id='273d5db93ced48419d5f00152f4bb1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1349f6-7ef5-4927-a788-ae31fa2776e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1349f6-7ef5-4927-a788-ae31fa2776e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be7f67a-8cb1-44fa-82c1-7fbda1a6153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be7f67a-8cb1-44fa-82c1-7fbda1a6153b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '869c26ba-3c90-485c-ab6f-1bfd248d8837', 'volume_name': 'volume-869c26ba-3c90-485c-ab6f-1bfd248d8837', 'volume_size': 1, 'snapshot_id': '5b62c300-c155-4c0e-9dfd-5a807748681e'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c629ac3e-a012-4438-904b-add9c5820714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c629ac3e-a012-4438-904b-add9c5820714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0784137c-a0d8-4b99-b502-5f54ae29a136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:37 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Volume 869c26ba-3c90-485c-ab6f-1bfd248d8837: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-869c26ba-3c90-485c-ab6f-1bfd248d8837', 'volume_size': 1, 'snapshot_id': '5b62c300-c155-4c0e-9dfd-5a807748681e'} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-5b62c300-c155-4c0e-9dfd-5a807748681e-869c26ba-3c90-485c-ab6f-1bfd248d8837" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-5b62c300-c155-4c0e-9dfd-5a807748681e-869c26ba-3c90-485c-ab6f-1bfd248d8837" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Creating volume 869c26ba-3c90-485c-ab6f-1bfd248d8837 from snapshot 5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-869c26ba-3c90-485c-ab6f-1bfd248d8837" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-869c26ba-3c90-485c-ab6f-1bfd248d8837" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] snapshot: 5b62c300-c155-4c0e-9dfd-5a807748681e, volume: 869c26ba-3c90-485c-ab6f-1bfd248d8837, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7385882-fd7a-4504-89a3-095c6110db78]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:37 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e Jun 04 14:49:37 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:38 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e" returned: 0 in 0.888s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:49:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:49:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:49:38 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5827b9d-6ce5-4fa3-af1d-3f30e8a0a2d2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:38 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:38 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:39 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:39 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:49:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:39 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 Jun 04 14:49:39 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Flow 'volume_create_manager' (2be81315-c19a-44b0-bcbc-f00418a77c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d976a1a7-9ad3-4d0f-b703-fd8b363c5591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d976a1a7-9ad3-4d0f-b703-fd8b363c5591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1864721219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e72db0d-4ac5-455e-8957-15b8f6bf99f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac9159064274713a7ebccba85abd68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:49:45Z,use_quota=True,user_id='1af8d34f30a443dbbdef57db21048a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c8ae7d-d3cb-4345-8a44-38fe4a2b5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c8ae7d-d3cb-4345-8a44-38fe4a2b5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c2a368-ac89-43e2-92bb-145692594153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c2a368-ac89-43e2-92bb-145692594153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'volume_name': 'volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bad3c7-26a4-49d3-81e1-c1adbfadf68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bad3c7-26a4-49d3-81e1-c1adbfadf68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71167b98-5322-4ab3-94d5-772f680f3661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:45 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Volume 4e72db0d-4ac5-455e-8957-15b8f6bf99f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'volume_size': 1} Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:45 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837" returned: 0 in 5.842s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6e658-aa7e-4853-9708-79a6e6013a06]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:45 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:45 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:46 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 1.096s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:46 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:49:46 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Converted 1024.00 MB image at 175.24 MB/s Jun 04 14:49:46 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 is being set with open permissions: ugo+rw Jun 04 14:49:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:46 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 Jun 04 14:49:46 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:47 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837" returned: 0 in 0.617s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-869c26ba-3c90-485c-ab6f-1bfd248d8837" released by "_copy_volume_from_snapshot" :: held 9.403s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-5b62c300-c155-4c0e-9dfd-5a807748681e-869c26ba-3c90-485c-ab6f-1bfd248d8837" released by "_create_volume_from_snapshot" :: held 9.438s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.458s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1864721219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e72db0d-4ac5-455e-8957-15b8f6bf99f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac9159064274713a7ebccba85abd68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:49:45Z,use_quota=True,user_id='1af8d34f30a443dbbdef57db21048a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Creating volume 4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:49:47 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:47 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 1073741824 Jun 04 14:49:47 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0784137c-a0d8-4b99-b502-5f54ae29a136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869c26ba-3c90-485c-ab6f-1bfd248d8837', 'volume_size': 1, 'snapshot_id': '5b62c300-c155-4c0e-9dfd-5a807748681e'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c540df40-85c2-42a5-98a4-382657e4e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:47 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Volume volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 (869c26ba-3c90-485c-ab6f-1bfd248d8837): created successfully Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c540df40-85c2-42a5-98a4-382657e4e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Flow 'volume_create_manager' (b13252d9-ff2a-4ff4-937f-1755255521e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:47 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9aae00c6-d495-45a0-acc1-e7fa4a1d6693 tempest-VolumesSnapshotTestJSON-726317979 None] Created volume successfully. Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-869c26ba-3c90-485c-ab6f-1bfd248d8837-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-869c26ba-3c90-485c-ab6f-1bfd248d8837-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-869c26ba-3c90-485c-ab6f-1bfd248d8837" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-869c26ba-3c90-485c-ab6f-1bfd248d8837" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d185277-49c7-40e7-826b-9ca7aa132b55]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:48 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 1073741824" returned: 0 in 1.149s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:48 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 Jun 04 14:49:48 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:48 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:49:48 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:49 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837" returned: 0 in 0.907s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:49 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 0.785s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:49 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837 Jun 04 14:49:49 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71167b98-5322-4ab3-94d5-772f680f3661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32bc271-4571-4207-a48c-cd0fc19dc369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:49 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Volume volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 (4e72db0d-4ac5-455e-8957-15b8f6bf99f9): created successfully Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32bc271-4571-4207-a48c-cd0fc19dc369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Flow 'volume_create_manager' (2be81315-c19a-44b0-bcbc-f00418a77c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:49 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-af9df44c-f132-4902-afd8-66c9663ea352 tempest-VolumesCloneTest-1784646044 None] Created volume successfully. Jun 04 14:49:50 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-869c26ba-3c90-485c-ab6f-1bfd248d8837" returned: 0 in 0.889s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-869c26ba-3c90-485c-ab6f-1bfd248d8837" released by "delete_volume" :: held 1.874s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['36bd2082-9ba8-4a56-9708-2d0bedb48c9b', '468d19c2-30b2-44f2-906b-784c87ff6a84', '2c18ff16-e9e3-4ec9-9cab-3596e259ac2d', '475bd2d6-6365-4729-bfa2-efbaa40600ed'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:50 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:49:50 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-5b62c300-c155-4c0e-9dfd-5a807748681e-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-5b62c300-c155-4c0e-9dfd-5a807748681e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-81b11c6a-7b96-4dd5-bbfa-204facd88c04" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-81b11c6a-7b96-4dd5-bbfa-204facd88c04" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-5b62c300-c155-4c0e-9dfd-5a807748681e" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-5b62c300-c155-4c0e-9dfd-5a807748681e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Deleting offline snapshot 5b62c300-c155-4c0e-9dfd-5a807748681e of volume 81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] snapshot_file for this snap is: volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[13528b5c-8308-4d78-b0f8-e876a727598a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Flow 'volume_create_manager' (a7d06038-0d6c-44a0-8d8e-97b2acf39128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86192b25-cf6c-4f0c-ae2f-b9057fad7ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:50 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e Jun 04 14:49:50 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86192b25-cf6c-4f0c-ae2f-b9057fad7ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2097684271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d902dca6-2270-4fec-82f7-3ac66006271d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac9159064274713a7ebccba85abd68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:49:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4e72db0d-4ac5-455e-8957-15b8f6bf99f9,status='creating',terminated_at=None,updated_at=2026-06-04T12:49:51Z,use_quota=True,user_id='1af8d34f30a443dbbdef57db21048a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6dce43-0223-4c40-a5e1-9459ee7d42e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6dce43-0223-4c40-a5e1-9459ee7d42e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf84cf18-59b2-42ba-8862-fa4f1b68f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf84cf18-59b2-42ba-8862-fa4f1b68f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd902dca6-2270-4fec-82f7-3ac66006271d', 'volume_name': 'volume-d902dca6-2270-4fec-82f7-3ac66006271d', 'volume_size': 2, 'source_volid': '4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'source_volstatus': 'available'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774c2667-d2c1-4a99-a761-3a327d79bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774c2667-d2c1-4a99-a761-3a327d79bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed18f0e-e2e3-4a0c-be07-434f3dc7c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:49:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Volume d902dca6-2270-4fec-82f7-3ac66006271d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d902dca6-2270-4fec-82f7-3ac66006271d', 'volume_size': 2, 'source_volid': '4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'source_volstatus': 'available'} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:50 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Cloning volume 4e72db0d-4ac5-455e-8957-15b8f6bf99f9 to volume d902dca6-2270-4fec-82f7-3ac66006271d Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Creating offline snapshot 225fd22f-1bb2-48fb-9b1a-a940ab299895 of volume 4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[580fa1e7-3e78-468d-ba09-8083e62a5bbf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:51 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:49:51 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:51 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.036s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:49:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Deleted volume successfully. Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1bcb8d71-4d41-4678-88be-2fbb97d30412 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-869c26ba-3c90-485c-ab6f-1bfd248d8837-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:51 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e" returned: 0 in 0.992s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8466fbd8-f153-432c-a67b-535e95c13144]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:51 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:51 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:51 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:51 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 1G Jun 04 14:49:51 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:52 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 0.928s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:52 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e Jun 04 14:49:52 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:53 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 1G" returned: 0 in 1.087s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:53 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 Jun 04 14:49:53 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:53 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e" returned: 0 in 0.850s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:53 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e Jun 04 14:49:53 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:53 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895" returned: 0 in 0.727s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:53 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 is being set with open permissions: ugo+rw Jun 04 14:49:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:53 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 Jun 04 14:49:53 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:54 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04.5b62c300-c155-4c0e-9dfd-5a807748681e" returned: 0 in 0.675s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-5b62c300-c155-4c0e-9dfd-5a807748681e" released by "_delete_snapshot" :: held 3.583s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-81b11c6a-7b96-4dd5-bbfa-204facd88c04" released by "delete_snapshot" :: held 3.607s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['26d4f5b5-ca10-4da4-8c59-2254184058b8', 'f55b072e-2c45-47ef-b208-04a8c67c930b', '1663480f-688d-483c-b9d9-064e811e5ca4', '757b6fdd-0174-4281-945b-dd8aacb8ccf2'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:49:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Delete snapshot completed successfully. Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d9cc9289-ac02-483b-b648-5732bed1f13e tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-5b62c300-c155-4c0e-9dfd-5a807748681e-delete_snapshot" released by "delete_snapshot" :: held 3.775s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:54 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895" returned: 0 in 0.701s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:54 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info Jun 04 14:49:54 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-81b11c6a-7b96-4dd5-bbfa-204facd88c04-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-81b11c6a-7b96-4dd5-bbfa-204facd88c04-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-81b11c6a-7b96-4dd5-bbfa-204facd88c04" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-81b11c6a-7b96-4dd5-bbfa-204facd88c04" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[122010eb-ffbe-4805-8626-a73bf0419517]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:55 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info" returned: 0 in 0.642s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:55 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info is being set with open permissions: ugo+rw Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:55 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info Jun 04 14:49:55 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:55 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:55 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:55 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.info" returned: 0 in 0.638s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "cinder-quobyte-d902dca6-2270-4fec-82f7-3ac66006271d" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-d902dca6-2270-4fec-82f7-3ac66006271d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] snapshot: 225fd22f-1bb2-48fb-9b1a-a940ab299895, volume: d902dca6-2270-4fec-82f7-3ac66006271d, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d1016-8798-432b-ac5b-404375398200]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:55 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 0.805s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:55 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04 Jun 04 14:49:55 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:55 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 Jun 04 14:49:55 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:56 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-81b11c6a-7b96-4dd5-bbfa-204facd88c04" returned: 0 in 0.619s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-81b11c6a-7b96-4dd5-bbfa-204facd88c04" released by "delete_volume" :: held 1.556s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['36746034-af7d-49e2-8026-360643f88c79', '5fb5ffa9-b884-4d31-be3f-82269244972a', 'f5afc07e-d89d-47f8-95fc-9f407bb8e3e3', '54d9131d-c7d1-448d-8bdc-39c134d6b9a6'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:49:56 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895" returned: 0 in 0.776s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f6041-44d6-4a2a-8290-2836ef0f21a2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:49:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:56 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:49:56 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:56 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:49:56 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-b3c27416-023d-4444-ac96-f1b162f40014-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-b3c27416-023d-4444-ac96-f1b162f40014-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "cinder-quobyte-b3c27416-023d-4444-ac96-f1b162f40014" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:49:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-b3c27416-023d-4444-ac96-f1b162f40014" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:49:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c93b7a-1b10-49dc-ad99-813bd34927e4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:49:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:57 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 Jun 04 14:49:57 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:58 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.662s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:58 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:49:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Deleted volume successfully. Jun 04 14:49:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b4139365-00e3-4445-a568-dbf970384c8f tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-81b11c6a-7b96-4dd5-bbfa-204facd88c04-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:49:58 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 1.849s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:58 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:49:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:58 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d Jun 04 14:49:58 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:49:59 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jun 04 14:49:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014" returned: 0 in 1.315s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:49:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:49:59 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014 Jun 04 14:49:59 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:01 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b3c27416-023d-4444-ac96-f1b162f40014" returned: 0 in 2.185s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-quobyte-b3c27416-023d-4444-ac96-f1b162f40014" released by "delete_volume" :: held 3.687s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Created reservations ['8fd52a40-77a0-4501-9fd7-3a406fcbfdd9', '0392f53b-d7b0-4195-9243-40ae2e7ff20d', '39724054-3a09-429d-929f-b9c8ba4c1630', 'aeb0ff7d-5eb1-4502-a2f6-8de8be6cba8d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:01 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:01 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:03 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.646s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:03 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Deleted volume successfully. Jun 04 14:50:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58fe5f9d-f618-4cff-8ac4-60ffc20f7c65 tempest-VolumesSnapshotTestJSON-726317979 None] Lock "cinder-b3c27416-023d-4444-ac96-f1b162f40014-delete_volume" released by "delete_volume" :: held 5.943s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:06 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d" returned: 0 in 7.617s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f9b8d5-553c-4d50-9270-59f0f1da4af0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:06 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:50:06 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:07 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 1.192s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:07 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:50:07 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Converted 1024.00 MB image at 134.41 MB/s Jun 04 14:50:07 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d is being set with open permissions: ugo+rw Jun 04 14:50:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:07 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d Jun 04 14:50:07 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:08 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d" returned: 0 in 0.726s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-d902dca6-2270-4fec-82f7-3ac66006271d" released by "_copy_volume_from_snapshot" :: held 12.259s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "cinder-quobyte-225fd22f-1bb2-48fb-9b1a-a940ab299895" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-225fd22f-1bb2-48fb-9b1a-a940ab299895" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Deleting offline snapshot 225fd22f-1bb2-48fb-9b1a-a940ab299895 of volume 4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] snapshot_file for this snap is: volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f8f1f3-2e58-442a-86ae-c3e3b799cb90]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:08 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 Jun 04 14:50:08 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:09 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895" returned: 0 in 1.052s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:50:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46970f51-610d-4361-b2e3-43d1ec9318ee]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:09 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:50:09 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:10 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 1.351s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:10 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 Jun 04 14:50:10 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:11 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895" returned: 0 in 1.038s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:11 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895 Jun 04 14:50:11 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:12 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9.225fd22f-1bb2-48fb-9b1a-a940ab299895" returned: 0 in 0.782s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-225fd22f-1bb2-48fb-9b1a-a940ab299895" released by "_delete_snapshot" :: held 4.338s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=46,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=43,cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.511s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed18f0e-e2e3-4a0c-be07-434f3dc7c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d902dca6-2270-4fec-82f7-3ac66006271d', 'volume_size': 2, 'source_volid': '4e72db0d-4ac5-455e-8957-15b8f6bf99f9', 'source_volstatus': 'available'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5de63e1-fd4e-42a2-8964-c83b864413b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:12 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Volume volume-d902dca6-2270-4fec-82f7-3ac66006271d (d902dca6-2270-4fec-82f7-3ac66006271d): created successfully Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5de63e1-fd4e-42a2-8964-c83b864413b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Flow 'volume_create_manager' (a7d06038-0d6c-44a0-8d8e-97b2acf39128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e307896b-8b25-4ecf-b637-80a164e4f158 tempest-VolumesCloneTest-1784646044 None] Created volume successfully. Jun 04 14:50:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "cinder-d902dca6-2270-4fec-82f7-3ac66006271d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-d902dca6-2270-4fec-82f7-3ac66006271d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "cinder-quobyte-d902dca6-2270-4fec-82f7-3ac66006271d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-d902dca6-2270-4fec-82f7-3ac66006271d" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4263bc2-0cd9-4392-a046-216dec64adbf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:13 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d Jun 04 14:50:13 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:14 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d" returned: 0 in 0.794s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:14 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d Jun 04 14:50:14 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:15 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d902dca6-2270-4fec-82f7-3ac66006271d" returned: 0 in 0.633s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-d902dca6-2270-4fec-82f7-3ac66006271d" released by "delete_volume" :: held 1.480s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Created reservations ['ac848616-3077-4085-b12d-b390776538cb', 'af70c36b-62c6-44fe-ba27-5d94da144899', '31c0d4a2-bc52-49a8-8644-fee2b3c8627e', 'b396e831-930e-499c-aa5e-4ef0b07a5df0'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:15 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:15 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Acquiring lock "cinder-4e72db0d-4ac5-455e-8957-15b8f6bf99f9-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:16 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.747s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Deleted volume successfully. Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Lock "cinder-4e72db0d-4ac5-455e-8957-15b8f6bf99f9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-118b3a20-03af-401d-b816-3b51a67003e1 tempest-VolumesCloneTest-1784646044 None] Lock "cinder-d902dca6-2270-4fec-82f7-3ac66006271d-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Acquiring lock "cinder-quobyte-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b21e7c-bce8-451c-b5f7-5df922df1afb]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:16 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:50:16 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:17 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 0.864s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:17 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9 Jun 04 14:50:17 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:18 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" returned: 0 in 0.936s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Lock "cinder-quobyte-4e72db0d-4ac5-455e-8957-15b8f6bf99f9" released by "delete_volume" :: held 1.884s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Created reservations ['1e03feca-2a44-469a-b911-2f3a29ae0076', '144c1da7-69a1-459d-8872-c7768c0baf87', '3c1f41f7-3ec7-407c-9eed-a409b1b5d06a', '7cddef7a-0b49-414d-b81b-b22d20fc4582'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:18 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:18 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:19 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.227s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:19 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Deleted volume successfully. Jun 04 14:50:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ae65dbc0-caa3-47b6-8fb2-57fa7b4aae9a tempest-VolumesCloneTest-1784646044 None] Lock "cinder-4e72db0d-4ac5-455e-8957-15b8f6bf99f9-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:22 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:22 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:23 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.168s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Flow 'volume_create_manager' (c2bde774-8133-4229-a8ba-bdf9b67c002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d76dfdf-f4cf-4472-bb39-5472cbc85f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d76dfdf-f4cf-4472-bb39-5472cbc85f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-920502316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7418e3c9-de58-4023-a4a3-aaa9280bc2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da82a3475344c1e8a09a900e64fee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:27Z,use_quota=True,user_id='2820e3d8ef6e40089bfa1e1391c24f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ed2feb-ca1c-4d9e-aaba-498ec0831982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ed2feb-ca1c-4d9e-aaba-498ec0831982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e889038-0374-4e91-b34e-7732df1b2ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e889038-0374-4e91-b34e-7732df1b2ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7418e3c9-de58-4023-a4a3-aaa9280bc2c5', 'volume_name': 'volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39372db-0ed6-4ec5-8c0e-b3a9a36ddafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39372db-0ed6-4ec5-8c0e-b3a9a36ddafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700e00c9-2c9c-4c03-beef-3935154ea46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:27 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Volume 7418e3c9-de58-4023-a4a3-aaa9280bc2c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 14:50:27 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Trying to clone 7418e3c9-de58-4023-a4a3-aaa9280bc2c5 from image d02c254e-91bb-4869-903e-8451e5a50689 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 14:50:28 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 14:50:28 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Image download 20.69 MB at 20.69 MB/s Jun 04 14:50:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee9cf8-a2c9-43f5-860f-71ea7ef399fb]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:28 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD Jun 04 14:50:28 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:29 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:29 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 is fetched for user 2820e3d8ef6e40089bfa1e1391c24f7c. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 14:50:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45397d-406f-4e00-860a-57658710b6d1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:29 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD Jun 04 14:50:29 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "cinder-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "cinder-quobyte-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-quobyte-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00306eb-63ae-4729-a4dc-c43c6dbf6760]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:30 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD" returned: 0 in 1.208s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-920502316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7418e3c9-de58-4023-a4a3-aaa9280bc2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da82a3475344c1e8a09a900e64fee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:27Z,use_quota=True,user_id='2820e3d8ef6e40089bfa1e1391c24f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Creating volume 7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:50:30 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:50:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:30 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 1073741824 Jun 04 14:50:30 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:30 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee Jun 04 14:50:30 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:31 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee" returned: 0 in 1.006s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:31 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee Jun 04 14:50:31 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:31 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 1073741824" returned: 0 in 1.036s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:31 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:31 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:32 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee" returned: 0 in 0.735s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-quobyte-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee" released by "delete_volume" :: held 1.844s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Created reservations ['c71bf6a2-43ff-44e8-8601-e0f0592dac49', '5cc801e9-1369-49d4-b3c7-fa2e9b9184ae', '44812519-baff-4fef-bd39-8aee675efdf9', 'bea69243-e0df-48c8-b4d9-5d0b9027c54e'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:32 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:32 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:32 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 0 in 0.982s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Attempting download of d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume 7418e3c9-de58-4023-a4a3-aaa9280bc2c5. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "cinder-9878710d-b2bc-4cc7-b744-7e04f0a6452d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[120c6459-1526-4071-b7c5-2e325c923075]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-9878710d-b2bc-4cc7-b744-7e04f0a6452d-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "cinder-quobyte-9878710d-b2bc-4cc7-b744-7e04f0a6452d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-quobyte-9878710d-b2bc-4cc7-b744-7e04f0a6452d" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b126c804-a0e9-4c09-9807-911f3f15a1a6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:32 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s Jun 04 14:50:32 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:33 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d Jun 04 14:50:33 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:33 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.958s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:33 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Deleted volume successfully. Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f7eafe70-be32-4460-af02-6e5407950709 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-b2439f03-a3ba-4503-8ba6-0dc2ab12fcee-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:33 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s" returned: 0 in 0.849s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:33 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s Jun 04 14:50:33 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:33 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d" returned: 0 in 0.898s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:33 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d Jun 04 14:50:33 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:34 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s" returned: 1 in 0.851s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_o29gd67s' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93dba4e-e285-4eec-a073-c9731f29f889]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:34 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9878710d-b2bc-4cc7-b744-7e04f0a6452d" returned: 0 in 0.771s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:34 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD Jun 04 14:50:34 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-quobyte-9878710d-b2bc-4cc7-b744-7e04f0a6452d" released by "delete_volume" :: held 1.738s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Created reservations ['54c14b4f-5029-4336-94c8-5748e13ac7e1', 'd8578024-f94c-416c-b9ca-c0d460e81b13', 'b7515982-a1ab-451a-a85e-87929a8cc749', 'e48bb7c4-3292-4c8c-8ba0-799349bca7c5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:34 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:34 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:35 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:35 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] d02c254e-91bb-4869-903e-8451e5a50689 was qcow2, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 14:50:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:35 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:35 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:35 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.868s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:35 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Deleted volume successfully. Jun 04 14:50:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aae071bb-f919-4f2b-8fbb-29bdcb2cb649 tempest-AttachVolumeShelveTestJSON-104748290 None] Lock "cinder-9878710d-b2bc-4cc7-b744-7e04f0a6452d-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:37 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 0 in 2.534s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:37 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_vwpg6eqgdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:50:37 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Converted 112.00 MB image at 44.18 MB/s Jun 04 14:50:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:37 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 1G Jun 04 14:50:37 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:38 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 1G" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:38 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb6066e-5bd4-487c-a743-7a3cb861e2ff]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:38 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:38 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:39 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 0 in 0.784s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:39 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:39 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:40 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 1 in 0.893s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Downloaded image d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume 7418e3c9-de58-4023-a4a3-aaa9280bc2c5 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 for user 2820e3d8ef6e40089bfa1e1391c24f7c is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Marking volume 7418e3c9-de58-4023-a4a3-aaa9280bc2c5 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Copying metadata from image d02c254e-91bb-4869-903e-8451e5a50689 to 7418e3c9-de58-4023-a4a3-aaa9280bc2c5. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Creating volume glance metadata for volume 7418e3c9-de58-4023-a4a3-aaa9280bc2c5 backed by image d02c254e-91bb-4869-903e-8451e5a50689 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700e00c9-2c9c-4c03-beef-3935154ea46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fef1918-68a6-4af6-b0cc-de077e039b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:40 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Volume volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 (7418e3c9-de58-4023-a4a3-aaa9280bc2c5): created successfully Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fef1918-68a6-4af6-b0cc-de077e039b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Flow 'volume_create_manager' (c2bde774-8133-4229-a8ba-bdf9b67c002c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7241303a-56af-44a5-969b-6131e4531890 tempest-VolumesExtendTest-1655972471 None] Created volume successfully. Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Flow 'volume_create_manager' (1e4b5362-06b9-4a9f-812d-0d90dfaf737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0c55a0-a909-43ce-ad28-8122d869213f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0c55a0-a909-43ce-ad28-8122d869213f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1888766737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3721044a-53ab-429d-92a6-9212dc6c9756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff12829d97cf4dd6ab7d471535826ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:41Z,use_quota=True,user_id='1ae378f858e94c72941e54241834e500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97fbd8a-9766-4d67-896a-14a2bcab2089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97fbd8a-9766-4d67-896a-14a2bcab2089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5d8568-9d09-4330-a19e-78927cadfa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5d8568-9d09-4330-a19e-78927cadfa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3721044a-53ab-429d-92a6-9212dc6c9756', 'volume_name': 'volume-3721044a-53ab-429d-92a6-9212dc6c9756', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8ffe67-8518-4e29-b666-5de8c253f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8ffe67-8518-4e29-b666-5de8c253f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d620b1-268c-47d6-bfca-c70c0e345ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Volume 3721044a-53ab-429d-92a6-9212dc6c9756: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3721044a-53ab-429d-92a6-9212dc6c9756', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Trying to clone 3721044a-53ab-429d-92a6-9212dc6c9756 from image d02c254e-91bb-4869-903e-8451e5a50689 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc2b5f2-c531-4a84-bb50-d3b109fcd915]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:42 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:42 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:42 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 14:50:42 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Image download 20.69 MB at 20.69 MB/s Jun 04 14:50:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c89a003-3295-4e32-9ae1-e230feb0dd81]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:42 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD Jun 04 14:50:42 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:42 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 0 in 0.985s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:42 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 is fetched for user 1ae378f858e94c72941e54241834e500. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 14:50:43 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:43 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ecab99-0fff-449d-bece-98693890f172]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:43 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD Jun 04 14:50:43 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:43 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:43 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 1 in 0.968s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 2G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 2G" returned: 0 in 0.070s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.090s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1888766737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3721044a-53ab-429d-92a6-9212dc6c9756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff12829d97cf4dd6ab7d471535826ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:41Z,use_quota=True,user_id='1ae378f858e94c72941e54241834e500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Creating volume 3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:50:43 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:50:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:43 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 1073741824 Jun 04 14:50:43 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-bfed4cc2-1008-4b0d-bfca-3455e8b2762e tempest-VolumesExtendTest-1655972471 None] Extend volume completed successfully. Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-7418e3c9-de58-4023-a4a3-aaa9280bc2c5-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Lock "cinder-7418e3c9-de58-4023-a4a3-aaa9280bc2c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-quobyte-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" acquired by "delete_volume" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78b92c-1413-4af4-8441-5dcb517e628c]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:44 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:44 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:44 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 1073741824" returned: 0 in 0.913s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:44 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:50:44 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:45 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 0 in 0.819s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:45 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:45 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:45 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 0.723s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Attempting download of d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume 3721044a-53ab-429d-92a6-9212dc6c9756. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[531860cd-7fab-4865-9116-b60da069553c]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:45 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo Jun 04 14:50:45 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:46 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 1 in 0.884s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:46 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5 Jun 04 14:50:46 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Flow 'volume_create_manager' (506f8cfa-6781-4165-be4f-5cdf44928e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a86b3c1-121f-4efd-a8a2-5fe0ebf1cf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a86b3c1-121f-4efd-a8a2-5fe0ebf1cf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-623749327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5261bf0-886c-4ed5-a1ec-623a892ebfcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29de292221e4fcf9352f2d0ce9a6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:46Z,use_quota=True,user_id='562a712c5aba4b1891ba82e2ee94d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894661b2-a851-4edf-915f-79cd2662e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894661b2-a851-4edf-915f-79cd2662e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4cc82d-64c9-4870-a8fb-873e5fe805a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4cc82d-64c9-4870-a8fb-873e5fe805a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5261bf0-886c-4ed5-a1ec-623a892ebfcb', 'volume_name': 'volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991522a3-e3d9-4756-aa68-824e8b49812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991522a3-e3d9-4756-aa68-824e8b49812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd810133-2c06-44d9-bda9-ba35f8c5d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:46 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Volume a5261bf0-886c-4ed5-a1ec-623a892ebfcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb', 'volume_size': 1} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-623749327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5261bf0-886c-4ed5-a1ec-623a892ebfcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29de292221e4fcf9352f2d0ce9a6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:46Z,use_quota=True,user_id='562a712c5aba4b1891ba82e2ee94d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Creating volume a5261bf0-886c-4ed5-a1ec-623a892ebfcb {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:50:46 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:46 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb 1073741824 Jun 04 14:50:46 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:46 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo" returned: 0 in 1.109s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:47 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo Jun 04 14:50:47 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:47 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" returned: 0 in 0.958s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-7418e3c9-de58-4023-a4a3-aaa9280bc2c5" released by "delete_volume" :: held 2.736s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Created reservations ['ebc421b1-4575-4fa1-aa09-e7c334f9cbbb', '03ad46e2-d849-497a-9bc6-72e1d97c9206', '4f07a3c4-7d44-4a67-b77f-ddd8b1a3fd8f', '70d112cb-0a00-4f51-bde7-8819b3f39101'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:47 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:50:47 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:47 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb 1073741824" returned: 0 in 1.101s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:47 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo" returned: 1 in 0.952s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_hcjy0_xo' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178dccf-4d85-4144-a984-eb0c165aa003]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:47 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb Jun 04 14:50:47 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:48 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD Jun 04 14:50:48 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:48 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.965s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:50:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Deleted volume successfully. Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-41d295cc-8509-4f99-890c-f89ea7895f18 tempest-VolumesExtendTest-1655972471 None] Lock "cinder-7418e3c9-de58-4023-a4a3-aaa9280bc2c5-delete_volume" released by "delete_volume" :: held 3.959s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Flow 'volume_create_manager' (0b32ff6a-ca9a-4c7e-845b-ec3a865685a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a0c13b-6042-4f8a-899d-5e86504ee9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a0c13b-6042-4f8a-899d-5e86504ee9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-57115203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53907e67-1f1a-4b28-9e1b-389b4bfb81cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da82a3475344c1e8a09a900e64fee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:48Z,use_quota=True,user_id='2820e3d8ef6e40089bfa1e1391c24f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b998bec-ae7a-48c1-aa12-2f9cefd26a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b998bec-ae7a-48c1-aa12-2f9cefd26a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d082f9d6-d459-4738-bcdf-7254ccc2fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d082f9d6-d459-4738-bcdf-7254ccc2fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53907e67-1f1a-4b28-9e1b-389b4bfb81cd', 'volume_name': 'volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c5d880-9621-494d-9274-94a0eaf2cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c5d880-9621-494d-9274-94a0eaf2cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fdf17d-0ba9-4ade-b730-189747fbf255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:48 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Volume 53907e67-1f1a-4b28-9e1b-389b4bfb81cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd', 'volume_size': 1} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:48 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" returned: 0 in 0.754s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-57115203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53907e67-1f1a-4b28-9e1b-389b4bfb81cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da82a3475344c1e8a09a900e64fee16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:50:48Z,use_quota=True,user_id='2820e3d8ef6e40089bfa1e1391c24f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Creating volume 53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:50:48 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd810133-2c06-44d9-bda9-ba35f8c5d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:48 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd 1073741824 Jun 04 14:50:48 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c445783-2426-4029-b2e4-6b052da08141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:48 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Volume volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb (a5261bf0-886c-4ed5-a1ec-623a892ebfcb): created successfully Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c445783-2426-4029-b2e4-6b052da08141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Flow 'volume_create_manager' (506f8cfa-6781-4165-be4f-5cdf44928e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-47f0f7bc-0c4d-4604-be33-dd5c22fbadb9 tempest-AttachVolumeTestJSON-1281504798 None] Created volume successfully. Jun 04 14:50:48 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD" returned: 0 in 0.953s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] d02c254e-91bb-4869-903e-8451e5a50689 was qcow2, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 14:50:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:48 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:50:48 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:49 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd 1073741824" returned: 0 in 0.966s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:49 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd Jun 04 14:50:49 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:50 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" returned: 0 in 0.908s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fdf17d-0ba9-4ade-b730-189747fbf255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836a5aeb-be21-4626-b86b-aab09dd85f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Volume volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd (53907e67-1f1a-4b28-9e1b-389b4bfb81cd): created successfully Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836a5aeb-be21-4626-b86b-aab09dd85f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Flow 'volume_create_manager' (0b32ff6a-ca9a-4c7e-845b-ec3a865685a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:50 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-91afb3af-da04-47ad-a794-f5632887abd5 tempest-VolumesExtendTest-1655972471 None] Created volume successfully. Jun 04 14:50:50 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 2.233s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:50 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_7h2sghg6devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:50:51 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Converted 112.00 MB image at 50.13 MB/s Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:51 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 1G Jun 04 14:50:51 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:51 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 1G" returned: 0 in 0.716s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47990d0e-4de4-4188-aa75-b104bff21116]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Creating offline snapshot 1e36b0b3-2921-4d20-b209-dc53686fc5ab of volume 53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:50:51 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:50:51 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2edf6b-8a5a-4078-b038-5d2533e6fa9b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:52 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd Jun 04 14:50:52 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:52 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 0.834s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:52 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:50:52 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:52 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" returned: 0 in 0.985s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:52 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab 1G Jun 04 14:50:52 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:53 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 1 in 0.879s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Downloaded image d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume 3721044a-53ab-429d-92a6-9212dc6c9756 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 for user 1ae378f858e94c72941e54241834e500 is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Marking volume 3721044a-53ab-429d-92a6-9212dc6c9756 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Copying metadata from image d02c254e-91bb-4869-903e-8451e5a50689 to 3721044a-53ab-429d-92a6-9212dc6c9756. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Creating volume glance metadata for volume 3721044a-53ab-429d-92a6-9212dc6c9756 backed by image d02c254e-91bb-4869-903e-8451e5a50689 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d620b1-268c-47d6-bfca-c70c0e345ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3721044a-53ab-429d-92a6-9212dc6c9756', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6879765-3391-4368-b914-97c0b927fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:50:53 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Volume volume-3721044a-53ab-429d-92a6-9212dc6c9756 (3721044a-53ab-429d-92a6-9212dc6c9756): created successfully Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6879765-3391-4368-b914-97c0b927fdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Flow 'volume_create_manager' (1e4b5362-06b9-4a9f-812d-0d90dfaf737c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:50:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-de1a18ec-016f-4fad-8470-7981339f9cbf tempest-TestShelveInstance-859101957 None] Created volume successfully. Jun 04 14:50:53 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab 1G" returned: 0 in 1.004s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:53 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab Jun 04 14:50:53 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:54 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:54 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab is being set with open permissions: ugo+rw Jun 04 14:50:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:54 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab Jun 04 14:50:54 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:55 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab" returned: 0 in 0.655s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:55 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info Jun 04 14:50:55 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:56 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info" returned: 0 in 0.710s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:56 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info is being set with open permissions: ugo+rw Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:56 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info Jun 04 14:50:56 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:56 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.info" returned: 0 in 0.710s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.930s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.659s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33750f4-afcf-4e9d-bdcd-0b9bafb4ce87]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:56 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-72f4c7e2-a543-458b-a2bd-e902e317bccb tempest-VolumesExtendTest-1655972471 None] Create snapshot completed successfully Jun 04 14:50:56 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb Jun 04 14:50:56 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:50:57 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" returned: 0 in 0.795s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.317s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e73704-ef06-49e7-bf21-80f871e2c49d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0aaf1940-45db-42b1-87f0-ba9ab2c3f195', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:50:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-3b839117-89e1-4758-92ab-acc019481284 req-f31618e6-55f7-4d0e-a9dd-c1bd71c7dabd tempest-AttachVolumeTestJSON-1281504798 None] attachment_update completed successfully. Jun 04 14:50:57 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd Jun 04 14:50:57 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:50:58 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jun 04 14:50:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" returned: 0 in 0.821s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab 2G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab 2G" returned: 0 in 0.148s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:50:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:50:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3e8d8118-e0c3-47c7-8c8d-af4328d5a928 tempest-VolumesExtendTest-1655972471 None] Extend volume completed successfully. Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-1e36b0b3-2921-4d20-b209-dc53686fc5ab-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Lock "cinder-1e36b0b3-2921-4d20-b209-dc53686fc5ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-quobyte-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-quobyte-1e36b0b3-2921-4d20-b209-dc53686fc5ab" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-1e36b0b3-2921-4d20-b209-dc53686fc5ab" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Deleting offline snapshot 1e36b0b3-2921-4d20-b209-dc53686fc5ab of volume 53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] snapshot_file for this snap is: volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a447b1-8915-4310-96ab-0000931d01a7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:50:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:50:59 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab Jun 04 14:50:59 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:00 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab" returned: 0 in 0.781s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:51:00 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5f34b-bce4-4c1c-84a0-fb26dfd62915]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:00 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd Jun 04 14:51:00 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:01 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" returned: 0 in 1.136s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:01 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab Jun 04 14:51:01 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f1e7a-b4e5-4ecb-85d6-932e07d150aa]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:01 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:51:01 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:02 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 0.859s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:02 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab" returned: 0 in 1.001s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:02 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab Jun 04 14:51:02 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:02 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:51:02 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Flow 'volume_create_manager' (3af941d4-8f86-402b-bbfe-c425a5d50c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db51b1b2-a850-4876-8d00-aef854859a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db51b1b2-a850-4876-8d00-aef854859a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-798953818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1325e73-8ed7-46f2-a874-5c1a1a15e8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29de292221e4fcf9352f2d0ce9a6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:03Z,use_quota=True,user_id='562a712c5aba4b1891ba82e2ee94d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3af62b-fc82-4fa5-8a86-7ba2843ee3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3af62b-fc82-4fa5-8a86-7ba2843ee3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e8b89-af92-4f8d-81c2-23810fa34de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e8b89-af92-4f8d-81c2-23810fa34de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1325e73-8ed7-46f2-a874-5c1a1a15e8bf', 'volume_name': 'volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a043a12d-a555-4d1b-a67a-8e16502e0853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a043a12d-a555-4d1b-a67a-8e16502e0853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae33a389-06c5-41e3-9d96-90bda7cbf089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:03 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Volume f1325e73-8ed7-46f2-a874-5c1a1a15e8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf', 'volume_size': 1} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:03 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd.1e36b0b3-2921-4d20-b209-dc53686fc5ab" returned: 0 in 0.725s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-1e36b0b3-2921-4d20-b209-dc53686fc5ab" released by "_delete_snapshot" :: held 3.765s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" released by "delete_snapshot" :: held 3.794s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Created reservations ['12e3047d-b5b2-48cd-86ee-93e764b9efb2', 'd0b401c0-91fb-4472-a766-02e79c981fdd', '105ff43d-a2cb-4eba-b0ab-46f65053fd1f', 'c9f0b539-5668-44dc-9975-961663706571'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:03 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 1 in 0.915s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.839s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-798953818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1325e73-8ed7-46f2-a874-5c1a1a15e8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29de292221e4fcf9352f2d0ce9a6e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:03Z,use_quota=True,user_id='562a712c5aba4b1891ba82e2ee94d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Creating volume f1325e73-8ed7-46f2-a874-5c1a1a15e8bf {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:03 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Delete snapshot completed successfully. Jun 04 14:51:03 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf 1073741824 Jun 04 14:51:03 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-00046688-3321-436b-ad91-f6eaaf09932b tempest-VolumesExtendTest-1655972471 None] Lock "cinder-1e36b0b3-2921-4d20-b209-dc53686fc5ab-delete_snapshot" released by "delete_snapshot" :: held 3.958s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-3721044a-53ab-429d-92a6-9212dc6c9756', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b9af056-3922-4ca9-8cb5-7c0b47f5aed0', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:51:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-50fad417-c1ad-4dc1-b198-fa3740697af1 req-bbddad7f-9ec9-4ce7-8ded-21b2478ebb0b tempest-TestShelveInstance-859101957 None] attachment_update completed successfully. Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-53907e67-1f1a-4b28-9e1b-389b4bfb81cd-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Lock "cinder-53907e67-1f1a-4b28-9e1b-389b4bfb81cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Acquiring lock "cinder-quobyte-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7840cd1-f547-4bd3-8815-3e3437cee6cc]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:04 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd Jun 04 14:51:04 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:04 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf 1073741824" returned: 0 in 0.902s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:04 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf Jun 04 14:51:04 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:05 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" returned: 0 in 0.658s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae33a389-06c5-41e3-9d96-90bda7cbf089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:05 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe35e64-cd6a-4bee-b226-74ce35ce90c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" returned: 0 in 0.904s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Volume volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf (f1325e73-8ed7-46f2-a874-5c1a1a15e8bf): created successfully Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe35e64-cd6a-4bee-b226-74ce35ce90c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Flow 'volume_create_manager' (3af941d4-8f86-402b-bbfe-c425a5d50c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:05 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd Jun 04 14:51:05 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:05 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8afce861-d83f-44f0-a7fe-8b0639202714 tempest-AttachVolumeTestJSON-1281504798 None] Created volume successfully. Jun 04 14:51:05 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" returned: 0 in 0.668s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Lock "cinder-quobyte-53907e67-1f1a-4b28-9e1b-389b4bfb81cd" released by "delete_volume" :: held 1.656s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:05 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Created reservations ['e5974ee5-db30-4eb7-a908-6f59af072566', '5878edf2-788d-45d4-bbf0-6edc3cfaed83', 'd4004944-cf9d-4e0c-b311-8dedb5b1f34d', '083bb4ed-9bfd-4242-bbf7-e5900c0fae79'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:06 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:06 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:06 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:06 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Deleted volume successfully. Jun 04 14:51:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-386078e4-4d67-4715-9201-81e83a8d41db tempest-VolumesExtendTest-1655972471 None] Lock "cinder-53907e67-1f1a-4b28-9e1b-389b4bfb81cd-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c7b64-0d62-4b30-a8ae-64b05861bfd2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:09 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf Jun 04 14:51:09 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:10 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (5226369d-a680-4ec2-8641-ad5c9e35803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ccac30-f844-4a30-b677-bb4860daca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" returned: 0 in 1.213s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.255s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ccac30-f844-4a30-b677-bb4860daca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552719244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0000fb49-43dd-4c15-9ffb-fef990925c86,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:10Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b3c38-4721-4c2e-bc72-672feb52934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b3c38-4721-4c2e-bc72-672feb52934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f798d8d-47a7-4ffb-935c-66973ee47b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f798d8d-47a7-4ffb-935c-66973ee47b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0000fb49-43dd-4c15-9ffb-fef990925c86', 'volume_name': 'volume-0000fb49-43dd-4c15-9ffb-fef990925c86', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc9d8bd-890a-4d34-be7d-83a37fcd3a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc9d8bd-890a-4d34-be7d-83a37fcd3a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b164c84-4f4a-4bea-b9e9-49926896c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Volume 0000fb49-43dd-4c15-9ffb-fef990925c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0000fb49-43dd-4c15-9ffb-fef990925c86', 'volume_size': 1} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552719244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0000fb49-43dd-4c15-9ffb-fef990925c86,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:10Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Creating volume 0000fb49-43dd-4c15-9ffb-fef990925c86 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:10 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:10 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 1073741824 Jun 04 14:51:10 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2ed2631-5b09-4b1c-893c-b7664470eaab', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:51:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-aeb2ff45-e63d-47b4-92ae-155cd3187ed9 req-f8b2c27e-390a-4cb2-8ed7-f49d80f3c122 tempest-AttachVolumeTestJSON-1281504798 None] attachment_update completed successfully. Jun 04 14:51:11 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 1073741824" returned: 0 in 1.111s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:11 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 Jun 04 14:51:11 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:12 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86" returned: 0 in 0.862s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=86,cinder:SELECT=89,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b164c84-4f4a-4bea-b9e9-49926896c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0000fb49-43dd-4c15-9ffb-fef990925c86', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca059d48-fc54-450f-b547-8ff88397e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=84,cinder:UPDATE=88,cinder:INSERT=31,cinder:DELETE=6 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:51:12 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Volume volume-0000fb49-43dd-4c15-9ffb-fef990925c86 (0000fb49-43dd-4c15-9ffb-fef990925c86): created successfully Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca059d48-fc54-450f-b547-8ff88397e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (5226369d-a680-4ec2-8641-ad5c9e35803f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4a5e7edf-1c94-475e-83ff-883fe9a2d004 tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (2f9ec187-141c-43bf-ac5f-fe5166df72f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64371465-f234-42e5-9f1b-34f0b73b5b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64371465-f234-42e5-9f1b-34f0b73b5b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1949651840',display_name='tempest-VolumesGetTest-Volume-586644940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e6f1e5-6640-4e92-a26e-96b98e86da28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:16Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab4837a-5633-4d18-942e-81e62c0f2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab4837a-5633-4d18-942e-81e62c0f2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedcfd76-6f0a-48fb-ae06-3732d7da475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedcfd76-6f0a-48fb-ae06-3732d7da475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e6f1e5-6640-4e92-a26e-96b98e86da28', 'volume_name': 'volume-16e6f1e5-6640-4e92-a26e-96b98e86da28', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1867fb04-f398-4a2f-8922-28e76f5fa84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1867fb04-f398-4a2f-8922-28e76f5fa84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829ed36d-d615-49d6-98f6-aae2763f3073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Volume 16e6f1e5-6640-4e92-a26e-96b98e86da28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e6f1e5-6640-4e92-a26e-96b98e86da28', 'volume_size': 1} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1949651840',display_name='tempest-VolumesGetTest-Volume-586644940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e6f1e5-6640-4e92-a26e-96b98e86da28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:16Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Creating volume 16e6f1e5-6640-4e92-a26e-96b98e86da28 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:15 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:15 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 1073741824 Jun 04 14:51:15 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:17 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 1073741824" returned: 0 in 1.458s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:17 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 Jun 04 14:51:17 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:18 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28" returned: 0 in 0.992s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] <== create_volume: return (2542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.548s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829ed36d-d615-49d6-98f6-aae2763f3073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e6f1e5-6640-4e92-a26e-96b98e86da28', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c17d37-66d9-4727-9d80-27d59d108db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:18 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Volume volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 (16e6f1e5-6640-4e92-a26e-96b98e86da28): created successfully Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c17d37-66d9-4727-9d80-27d59d108db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (2f9ec187-141c-43bf-ac5f-fe5166df72f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e65e924e-5276-4c4a-a2d9-a6eee30e226d tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:51:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-ca54f307-5f92-40b1-a235-792caa9fa5d1 req-409bb8de-793c-45e3-b5cc-7ab94d2b8330 tempest-AttachVolumeTestJSON-1281504798 None] Terminate volume connection completed successfully. Jun 04 14:51:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-ca54f307-5f92-40b1-a235-792caa9fa5d1 req-409bb8de-793c-45e3-b5cc-7ab94d2b8330 tempest-AttachVolumeTestJSON-1281504798 None] Deleting attachment 0aaf1940-45db-42b1-87f0-ba9ab2c3f195. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:51:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-16e6f1e5-6640-4e92-a26e-96b98e86da28-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Lock "cinder-16e6f1e5-6640-4e92-a26e-96b98e86da28-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-16e6f1e5-6640-4e92-a26e-96b98e86da28" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-16e6f1e5-6640-4e92-a26e-96b98e86da28" acquired by "delete_volume" :: waited 0.034s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:19 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[45952f6b-0972-4bca-ab95-49d46f9f1048]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:19 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 Jun 04 14:51:19 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:20 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28" returned: 0 in 1.315s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:20 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28 Jun 04 14:51:20 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:21 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-16e6f1e5-6640-4e92-a26e-96b98e86da28" returned: 0 in 0.639s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-16e6f1e5-6640-4e92-a26e-96b98e86da28" released by "delete_volume" :: held 2.077s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Created reservations ['394830f6-bfb9-487e-8b59-dabccee6f855', 'bdc23db5-3ec5-4993-a3d3-6e552a81ceb5', '0a3d6ba2-b442-496f-8900-f331af4f78d5', 'e7cd55f5-85be-4ba9-b388-9fbe088704f3'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:21 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:21 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-2ad726e4-fa14-47dd-b3fa-4728e7157978 req-4f976e47-d35a-41e8-9254-b5444ab45017 tempest-AttachVolumeTestJSON-1281504798 None] Terminate volume connection completed successfully. Jun 04 14:51:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-2ad726e4-fa14-47dd-b3fa-4728e7157978 req-4f976e47-d35a-41e8-9254-b5444ab45017 tempest-AttachVolumeTestJSON-1281504798 None] Deleting attachment c2ed2631-5b09-4b1c-893c-b7664470eaab. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:51:22 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.762s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7ca8d7a-63ba-476a-a692-439df9250d25 tempest-VolumesGetTest-1806513051 None] Lock "cinder-16e6f1e5-6640-4e92-a26e-96b98e86da28-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:22 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:22 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-0000fb49-43dd-4c15-9ffb-fef990925c86-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Lock "cinder-0000fb49-43dd-4c15-9ffb-fef990925c86-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-0000fb49-43dd-4c15-9ffb-fef990925c86" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-0000fb49-43dd-4c15-9ffb-fef990925c86" acquired by "delete_volume" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81321f54-2a1d-4c07-8ee8-ee5e33c762c3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:23 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 Jun 04 14:51:23 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:23 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.002s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:23 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86" returned: 0 in 0.890s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:23 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86 Jun 04 14:51:23 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:24 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0000fb49-43dd-4c15-9ffb-fef990925c86" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-0000fb49-43dd-4c15-9ffb-fef990925c86" released by "delete_volume" :: held 1.741s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Created reservations ['f0c36724-feb2-4d97-96e6-6f7fb1484948', '80cf798c-7082-4881-924f-4ccd7938d20e', '74e98359-45c4-47bb-b696-1ad424bcc7d4', '13e5b529-c0cf-414e-9621-937d1f5b05be'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:24 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:24 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (7742f1df-0250-4279-b01a-9bf97693aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf53576-a354-494b-8a88-36dba3674171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf53576-a354-494b-8a88-36dba3674171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2010395982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa2a5b-c2b1-4e46-a696-9c5125fcd234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:26Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263b9a3d-d32d-4a1d-9a22-f0ce83de1ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263b9a3d-d32d-4a1d-9a22-f0ce83de1ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfab85e0-6c5f-49c6-b7fc-f3d99d4a5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfab85e0-6c5f-49c6-b7fc-f3d99d4a5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'volume_name': 'volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fab8db4-13ef-4a5f-ac92-388c9c81a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fab8db4-13ef-4a5f-ac92-388c9c81a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650e7e63-6842-41a7-aa88-3aca60c79797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:25 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Volume 99aa2a5b-c2b1-4e46-a696-9c5125fcd234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'volume_size': 1} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2010395982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa2a5b-c2b1-4e46-a696-9c5125fcd234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:26Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Creating volume 99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:25 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:26 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 1073741824 Jun 04 14:51:26 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:26 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.251s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:26 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:26 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:51:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-40ade663-ea08-41bf-a5ba-467dcd21e59e tempest-VolumesGetTest-1806513051 None] Lock "cinder-0000fb49-43dd-4c15-9ffb-fef990925c86-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:27 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 1073741824" returned: 0 in 1.334s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:27 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:27 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:28 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 1.160s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650e7e63-6842-41a7-aa88-3aca60c79797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754da3d2-28d1-4833-a7a6-5734d8c0e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:28 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Volume volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 (99aa2a5b-c2b1-4e46-a696-9c5125fcd234): created successfully Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754da3d2-28d1-4833-a7a6-5734d8c0e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (7742f1df-0250-4279-b01a-9bf97693aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0bb9ced6-7d8a-49f6-b0a8-d3e1371a6bdd tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (39adce7a-ca38-4669-b8fb-e79db28d88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6041c16-3ec9-4a72-91d9-ac618ef61f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6041c16-3ec9-4a72-91d9-ac618ef61f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1220924092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=99aa2a5b-c2b1-4e46-a696-9c5125fcd234,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:29Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcdae1f-c674-48b6-a5e0-8c7c91651895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcdae1f-c674-48b6-a5e0-8c7c91651895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5ed300-deab-44fc-a629-d5eb95595e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5ed300-deab-44fc-a629-d5eb95595e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387', 'volume_name': 'volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387', 'volume_size': 1, 'source_volid': '99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'source_volstatus': 'available'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0531dc-5696-46d8-a11b-7f8a6f2599f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0531dc-5696-46d8-a11b-7f8a6f2599f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2362c8cc-f38f-4e08-b54c-e86a92ee63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:29 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Volume a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387', 'volume_size': 1, 'source_volid': '99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'source_volstatus': 'available'} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:29 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Cloning volume 99aa2a5b-c2b1-4e46-a696-9c5125fcd234 to volume a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Creating offline snapshot dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 of volume 99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c7e0c-4070-4b7a-a08f-8e6fb3a20a9a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:29 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:29 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:30 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 0.743s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:30 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 1G Jun 04 14:51:30 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:31 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 1G" returned: 0 in 0.733s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:31 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 Jun 04 14:51:31 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:31 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:31 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 is being set with open permissions: ugo+rw Jun 04 14:51:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:31 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 Jun 04 14:51:31 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:32 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" returned: 0 in 0.560s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:32 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info Jun 04 14:51:32 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:32 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info" returned: 0 in 0.626s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:32 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info is being set with open permissions: ugo+rw Jun 04 14:51:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:32 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info Jun 04 14:51:32 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "cinder-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "cinder-quobyte-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-quobyte-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39045e2-4494-483f-98fb-0a204934f88d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:33 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.info" returned: 0 in 0.650s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:33 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf Jun 04 14:51:33 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] snapshot: dc8d0cd2-e6fc-4343-a4bb-793ec15befc4, volume: a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1292043-5e51-4122-841f-4625175c4338]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:33 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 Jun 04 14:51:33 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:34 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" returned: 0 in 0.801s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:34 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf Jun 04 14:51:34 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:34 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" returned: 0 in 0.801s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f77cdcd-e3ca-4332-a4f1-be089945d1b9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:34 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:34 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:34 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" returned: 0 in 0.677s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-quobyte-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf" released by "delete_volume" :: held 1.528s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Created reservations ['8aba2619-abf1-4b3d-913f-e7beb82514fe', '1efad9ad-ad40-4d4c-8805-006c2c077f89', '66b4a0ea-1de8-4cf6-9d1d-caa6ae62c39f', 'e73a2783-b36a-47c3-bebd-bb82659c005c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:35 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:35 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:35 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 0.818s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:35 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 Jun 04 14:51:35 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "cinder-a5261bf0-886c-4ed5-a1ec-623a892ebfcb-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-a5261bf0-886c-4ed5-a1ec-623a892ebfcb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "cinder-quobyte-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-quobyte-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[70012c4f-82b0-4745-998b-cf1d4c3ac5c3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:35 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.794s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Deleted volume successfully. Jun 04 14:51:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d0bbf52-3156-48bc-a6ca-fa6f471dde71 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-f1325e73-8ed7-46f2-a874-5c1a1a15e8bf-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:36 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb Jun 04 14:51:36 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:37 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" returned: 0 in 1.613s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:37 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb Jun 04 14:51:37 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:39 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" returned: 0 in 1.593s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-quobyte-a5261bf0-886c-4ed5-a1ec-623a892ebfcb" released by "delete_volume" :: held 3.317s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Created reservations ['bc26aa49-8e2a-433f-b659-920d3f6655d2', 'f6a00036-7ed3-46a6-b593-1ab4704a7d7c', '0659e206-b30e-4396-a5df-5d25db15072f', 'ac9b0fad-86ef-496c-97ba-596f7f9cab25'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:39 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:39 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "cinder-239f9a0c-18c2-42de-a35e-87ccbc57ca97-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-239f9a0c-18c2-42de-a35e-87ccbc57ca97-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "cinder-quobyte-239f9a0c-18c2-42de-a35e-87ccbc57ca97" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-quobyte-239f9a0c-18c2-42de-a35e-87ccbc57ca97" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259ea6d-eac8-4fb1-af9f-0a279c77407a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Flow 'volume_create_manager' (a10c5d9b-2cb6-4157-90a5-e8adfe32f0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49a586a-c104-4e13-865a-0f6c55806964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:41 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.898s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Deleted volume successfully. Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49a586a-c104-4e13-865a-0f6c55806964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1204322505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3208154ae4bb429b800ca57a49bf68a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:41Z,use_quota=True,user_id='1fab8e11866f4e719ee0a143a4e7d055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fa5d96-4908-4251-8f45-adcfe58ff7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fa5d96-4908-4251-8f45-adcfe58ff7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3e8252-d21c-409f-b706-0a4ddd7e8882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3e8252-d21c-409f-b706-0a4ddd7e8882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc', 'volume_name': 'volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a7c182-67b0-4ab7-8118-7785fac95f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a7c182-67b0-4ab7-8118-7785fac95f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858f5b07-e0ca-47fe-9ba0-ae09c96c9b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Volume ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc', 'volume_size': 1} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-54bef873-8a2f-4ec8-9469-d8df8d96d106 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-a5261bf0-886c-4ed5-a1ec-623a892ebfcb-delete_volume" released by "delete_volume" :: held 5.828s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:41 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 Jun 04 14:51:41 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:42 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" returned: 0 in 7.190s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0fc13d-6099-43e1-b680-f49fa3a1b3f4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:42 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:42 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:42 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97" returned: 0 in 1.513s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:42 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97 Jun 04 14:51:42 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:43 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-239f9a0c-18c2-42de-a35e-87ccbc57ca97" returned: 0 in 0.635s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-quobyte-239f9a0c-18c2-42de-a35e-87ccbc57ca97" released by "delete_volume" :: held 2.306s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:43 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 0.941s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:51:43 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Converted 1024.00 MB image at 142.41 MB/s Jun 04 14:51:43 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 is being set with open permissions: ugo+rw Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Created reservations ['286ebfcb-5bb6-4a7d-a193-5f0b73fa500e', 'd5613b1a-ff75-4f1f-ae84-baceebd88fff', '278ece7a-99aa-45ce-a669-ab0c563f7ff1', '8aaf9053-b930-49a1-84f5-5f5d615355a1'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:43 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 Jun 04 14:51:43 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:43 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:43 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:44 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" returned: 0 in 0.656s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" released by "_copy_volume_from_snapshot" :: held 10.531s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Deleting offline snapshot dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 of volume 99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] snapshot_file for this snap is: volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5f3c2-5722-4368-a66e-53fc55d7d8ed]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:44 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.688s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Deleted volume successfully. Jun 04 14:51:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2cc1e8ce-ab19-4e24-8318-7983d537bd08 tempest-AttachVolumeTestJSON-1281504798 None] Lock "cinder-239f9a0c-18c2-42de-a35e-87ccbc57ca97-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:44 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 Jun 04 14:51:44 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:45 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" returned: 0 in 0.840s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b7ef0d-e86a-4fae-b777-0c92a31b23f7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:45 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:45 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:45 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-fc3b9249-2391-4820-a24e-c6d37015529d req-5be06b7d-2e74-44c5-8a7e-abef181235c5 tempest-TestShelveInstance-859101957 None] Terminate volume connection completed successfully. Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-fc3b9249-2391-4820-a24e-c6d37015529d req-5be06b7d-2e74-44c5-8a7e-abef181235c5 tempest-TestShelveInstance-859101957 None] Deleting attachment 0b9af056-3922-4ca9-8cb5-7c0b47f5aed0. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:51:45 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 0.877s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:46 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 Jun 04 14:51:46 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:46 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:46 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4 Jun 04 14:51:46 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:47 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234.dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" returned: 0 in 0.682s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-dc8d0cd2-e6fc-4343-a4bb-793ec15befc4" released by "_delete_snapshot" :: held 3.402s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.085s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.163s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1204322505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3208154ae4bb429b800ca57a49bf68a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:41Z,use_quota=True,user_id='1fab8e11866f4e719ee0a143a4e7d055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Creating volume ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:47 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2362c8cc-f38f-4e08-b54c-e86a92ee63f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387', 'volume_size': 1, 'source_volid': '99aa2a5b-c2b1-4e46-a696-9c5125fcd234', 'source_volstatus': 'available'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6c4ad8-8656-4bba-88ef-26358b70baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:47 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc 1073741824 Jun 04 14:51:47 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:47 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Volume volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 (a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387): created successfully Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6c4ad8-8656-4bba-88ef-26358b70baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (39adce7a-ca38-4669-b8fb-e79db28d88b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:47 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a7ad5d75-d7a3-4664-b8ab-ea0f0b9376e4 tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:51:48 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc 1073741824" returned: 0 in 1.178s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:48 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc Jun 04 14:51:48 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (3ddb7bdf-05d6-4be3-abf9-a8e1e8296f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d4460c-8918-4ee5-90bc-b846f15a92af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d4460c-8918-4ee5-90bc-b846f15a92af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539433735',display_name='tempest-VolumesGetTest-Volume-1629238654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:49Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dc66bc-fa50-4742-a45a-d5cd365be001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dc66bc-fa50-4742-a45a-d5cd365be001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd28cde-3c20-41a1-8109-8504205f95c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd28cde-3c20-41a1-8109-8504205f95c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a7c53f-44b9-48f7-9ce3-9c20213a0bc7', 'volume_name': 'volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05db9c7e-e9bb-4202-a0d7-3c4c8c2373cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05db9c7e-e9bb-4202-a0d7-3c4c8c2373cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58c84d3-18c0-4e89-aac8-ba558cb18297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:49 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Volume d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7', 'volume_size': 1} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:49 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" returned: 0 in 0.746s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539433735',display_name='tempest-VolumesGetTest-Volume-1629238654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:49Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Creating volume d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:49 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:49 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 1073741824 Jun 04 14:51:49 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858f5b07-e0ca-47fe-9ba0-ae09c96c9b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c244df-f88d-42e1-803f-8094b3758371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:49 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Volume volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc (ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc): created successfully Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c244df-f88d-42e1-803f-8094b3758371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Flow 'volume_create_manager' (a10c5d9b-2cb6-4157-90a5-e8adfe32f0ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:49 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fa15b0fa-5767-4272-944f-d94dec3fd25c tempest-AttachVolumeNegativeTest-1284004915 None] Created volume successfully. Jun 04 14:51:50 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 1073741824" returned: 0 in 0.927s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:50 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 Jun 04 14:51:50 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:51 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7" returned: 0 in 0.611s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58c84d3-18c0-4e89-aac8-ba558cb18297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f66c87-00f9-4605-a7fd-58eccb78cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:51 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Volume volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 (d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7): created successfully Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f66c87-00f9-4605-a7fd-58eccb78cace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (3ddb7bdf-05d6-4be3-abf9-a8e1e8296f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7deb24a3-1f1f-4312-9772-84b785b5a274 tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[968068dd-16d7-455c-9c90-fd9a798f8558]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:51 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:51:51 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:52 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 0.780s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Flow 'volume_create_manager' (8739e4da-211c-4450-95ff-acb954ce22eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da042e49-e4ea-4eaf-b752-839c49973434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da042e49-e4ea-4eaf-b752-839c49973434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1187855580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4ad6c7848264a1fbf55b4f7bf6b1453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:52Z,use_quota=True,user_id='6ac59c9005b5460ba3bb050ebe6c1f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2032959b-dbe4-458e-8a2d-e70d78fe45ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2032959b-dbe4-458e-8a2d-e70d78fe45ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2039b330-7242-468c-9e2c-2d8d8357c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:52 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:51:52 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2039b330-7242-468c-9e2c-2d8d8357c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f', 'volume_name': 'volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0239af-182a-415a-9a14-e5ef74c0249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0239af-182a-415a-9a14-e5ef74c0249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affe698f-1278-44ff-bf68-1b1c1278debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Volume 2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f', 'volume_size': 1} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Lock "cinder-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b96b78-4f3f-4159-b252-ebfeeaa3f3e9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:52 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 Jun 04 14:51:52 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:52 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 1 in 0.786s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.606s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1187855580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4ad6c7848264a1fbf55b4f7bf6b1453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:52Z,use_quota=True,user_id='6ac59c9005b5460ba3bb050ebe6c1f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Creating volume 2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:52 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:52 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f 1073741824 Jun 04 14:51:52 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-3721044a-53ab-429d-92a6-9212dc6c9756', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58db746c-a17c-4aed-9a92-896621b2a55d', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:51:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-10ea5c48-4148-4bbc-b1f1-af59a644a7c7 req-110ed73b-9ad7-4a39-8aab-5fbaeee0c3c2 tempest-TestShelveInstance-859101957 None] attachment_update completed successfully. Jun 04 14:51:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:53 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:53 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7 Jun 04 14:51:53 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:53 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f 1073741824" returned: 0 in 0.917s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:53 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f Jun 04 14:51:53 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:54 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7" returned: 0 in 0.648s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7" released by "delete_volume" :: held 1.473s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Created reservations ['00bb45f3-c257-4b82-b1ee-dde44f01a099', '66c0ef93-818e-409e-b382-4ace1678f261', 'a9f34c48-a53e-4b1b-ae5b-027ea69c13a4', '622d3ba7-1560-40d4-9682-6d8a364bb454'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:54 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:54 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:54 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f" returned: 0 in 0.658s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.442s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe5b7dc-ce8e-4e28-b180-7193288ac59c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affe698f-1278-44ff-bf68-1b1c1278debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8e2648-cc48-4e53-9c91-acbf4dc87684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:54 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Volume volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f (2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f): created successfully Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8e2648-cc48-4e53-9c91-acbf4dc87684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Flow 'volume_create_manager' (8739e4da-211c-4450-95ff-acb954ce22eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-eb8858b7-d0ef-45a1-80ab-abeba987333c tempest-VolumesTestJSON-2087393650 None] Created volume successfully. Jun 04 14:51:54 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc Jun 04 14:51:54 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:54 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:51:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0a97d1d2-bf60-4714-b8de-b2b45975e198 tempest-VolumesGetTest-1806513051 None] Lock "cinder-d6a7c53f-44b9-48f7-9ce3-9c20213a0bc7-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c86907-6b2f-43a7-b09e-83dd86153728]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:55 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 Jun 04 14:51:55 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:55 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" returned: 0 in 0.829s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f61b41a3-abb1-486c-85dc-008239189912', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:51:55 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-2c251880-6c43-4a69-9c10-c89c5e384c52 req-3499d5d3-3e19-461b-9bfd-e1a194588c70 tempest-AttachVolumeNegativeTest-1284004915 None] attachment_update completed successfully. Jun 04 14:51:55 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" returned: 0 in 0.784s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:55 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387 Jun 04 14:51:55 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Flow 'volume_create_manager' (8df24334-3d47-4344-9ca8-f52a8a468f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc8e616-ff3d-432b-9b61-fb5f23dab7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc8e616-ff3d-432b-9b61-fb5f23dab7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379157819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7bdc8-dd10-48ae-aba5-3d435eae8116,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4ad6c7848264a1fbf55b4f7bf6b1453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:56Z,use_quota=True,user_id='6ac59c9005b5460ba3bb050ebe6c1f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ce2a07-72c3-43a4-bf71-5a5253e0b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ce2a07-72c3-43a4-bf71-5a5253e0b9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fae16a-78d1-4e25-9f17-c547c5698a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fae16a-78d1-4e25-9f17-c547c5698a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a7bdc8-dd10-48ae-aba5-3d435eae8116', 'volume_name': 'volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adce3ec-f59e-4090-8d75-7494825e9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adce3ec-f59e-4090-8d75-7494825e9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adf8843-cc03-4c04-ba03-4ae4d8bb20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:56 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Volume 88a7bdc8-dd10-48ae-aba5-3d435eae8116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116', 'volume_size': 1} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379157819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7bdc8-dd10-48ae-aba5-3d435eae8116,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4ad6c7848264a1fbf55b4f7bf6b1453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:56Z,use_quota=True,user_id='6ac59c9005b5460ba3bb050ebe6c1f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Creating volume 88a7bdc8-dd10-48ae-aba5-3d435eae8116 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:56 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:56 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 1073741824 Jun 04 14:51:56 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:56 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" returned: 0 in 0.677s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387" released by "delete_volume" :: held 1.513s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Created reservations ['ee2660f4-63c9-43c7-a9f8-520979e8d0fb', 'f55535ee-42ff-4388-a334-ddf5abcad77d', '5ea2d98e-6f68-43c9-b83d-b9d46ed7c75a', '9e3815cd-8ed4-41d5-8d86-07c59146033c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:56 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:56 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:57 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 1073741824" returned: 0 in 0.843s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:57 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 Jun 04 14:51:57 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-99aa2a5b-c2b1-4e46-a696-9c5125fcd234-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Lock "cinder-99aa2a5b-c2b1-4e46-a696-9c5125fcd234-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:57 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.661s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:51:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-857cec62-a1c7-4608-9949-7cde90b2ade4 tempest-VolumesGetTest-1806513051 None] Lock "cinder-a0fc250d-9a8b-4c4b-9ebc-ea2d4e5c2387-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8526765-f1f0-49ab-bebd-be15ec7aa6ff]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:57 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:57 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:57 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116" returned: 0 in 0.697s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adf8843-cc03-4c04-ba03-4ae4d8bb20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2ee52e-6a9c-4bb7-94df-f8db0769d339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:57 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Volume volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 (88a7bdc8-dd10-48ae-aba5-3d435eae8116): created successfully Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2ee52e-6a9c-4bb7-94df-f8db0769d339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Flow 'volume_create_manager' (8df24334-3d47-4344-9ca8-f52a8a468f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-77c6ac63-d9c6-47f0-846e-a6c3bac04784 tempest-VolumesTestJSON-2087393650 None] Created volume successfully. Jun 04 14:51:58 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 0.742s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:58 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234 Jun 04 14:51:58 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:58 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:51:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Flow 'volume_create_manager' (1ae61218-e94d-4d4b-bc24-35659ab400ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:51:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b84fc98-bec6-45b6-8c2a-09e85a984aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b84fc98-bec6-45b6-8c2a-09e85a984aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-229695979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f979d551-7642-43f5-a1b2-e0bcdfa87db2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4ad6c7848264a1fbf55b4f7bf6b1453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:59Z,use_quota=True,user_id='6ac59c9005b5460ba3bb050ebe6c1f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfb0d55-d25e-46b5-8638-a3f372c81f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfb0d55-d25e-46b5-8638-a3f372c81f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5800c2bb-3723-482e-8ac6-f91b3e59edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5800c2bb-3723-482e-8ac6-f91b3e59edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f979d551-7642-43f5-a1b2-e0bcdfa87db2', 'volume_name': 'volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47e4834-2ab9-4448-b33f-ae7a73e526f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47e4834-2ab9-4448-b33f-ae7a73e526f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975e1ec0-3d90-4c3c-a759-243d739344f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:51:59 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Volume f979d551-7642-43f5-a1b2-e0bcdfa87db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2', 'volume_size': 1} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-229695979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f979d551-7642-43f5-a1b2-e0bcdfa87db2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4ad6c7848264a1fbf55b4f7bf6b1453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:51:59Z,use_quota=True,user_id='6ac59c9005b5460ba3bb050ebe6c1f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Creating volume f979d551-7642-43f5-a1b2-e0bcdfa87db2 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:59 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:51:59 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:59 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 1073741824 Jun 04 14:51:59 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-99aa2a5b-c2b1-4e46-a696-9c5125fcd234" released by "delete_volume" :: held 1.658s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Created reservations ['d799b276-3de3-4d6b-927b-1128203669f1', '4c9594b2-23af-464b-bb1a-07f5479f6f5f', 'f9d825de-1eb5-4e40-aaa6-73f8d072084b', 'b5c293ed-d883-4721-8c8a-1c9696814820'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:51:59 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:51:59 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:51:59 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.680s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:51:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:51:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e3eacb03-9d7b-496d-8a82-3166e4f351d3 tempest-VolumesGetTest-1806513051 None] Lock "cinder-99aa2a5b-c2b1-4e46-a696-9c5125fcd234-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:00 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 1073741824" returned: 0 in 0.963s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:00 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 Jun 04 14:52:00 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (ab4f16b1-519a-4b5b-aac3-7ea05bf23c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3270d8-7c91-4276-9f1d-6860fbaf267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3270d8-7c91-4276-9f1d-6860fbaf267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-228486290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc46b0e-3054-42cc-a626-59535a608d15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:00Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4688042-52ae-4eb0-9e85-f118548cc076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4688042-52ae-4eb0-9e85-f118548cc076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00f3bac-ccd6-43ce-99e7-9d753b58a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 14:52:00 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2" returned: 0 in 0.720s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975e1ec0-3d90-4c3c-a759-243d739344f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7e1ca5-66f9-42c8-8320-fbe57b1e6378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Volume volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 (f979d551-7642-43f5-a1b2-e0bcdfa87db2): created successfully Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7e1ca5-66f9-42c8-8320-fbe57b1e6378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Flow 'volume_create_manager' (1ae61218-e94d-4d4b-bc24-35659ab400ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6106c865-6f28-4efc-8061-d897d4aa28a9 tempest-VolumesTestJSON-2087393650 None] Created volume successfully. Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00f3bac-ccd6-43ce-99e7-9d753b58a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdc46b0e-3054-42cc-a626-59535a608d15', 'volume_name': 'volume-cdc46b0e-3054-42cc-a626-59535a608d15', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2808ba0-2d89-49f9-a45f-1da847491d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2808ba0-2d89-49f9-a45f-1da847491d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8573fb99-703a-4518-bd2c-3afe8eb19759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Volume cdc46b0e-3054-42cc-a626-59535a608d15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdc46b0e-3054-42cc-a626-59535a608d15', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 14:52:00 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Trying to clone cdc46b0e-3054-42cc-a626-59535a608d15 from image d02c254e-91bb-4869-903e-8451e5a50689 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 14:52:01 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 14:52:01 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Image download 20.69 MB at 20.69 MB/s Jun 04 14:52:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ea411d-9aac-441b-865f-70130e074796]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:01 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD Jun 04 14:52:01 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "cinder-f979d551-7642-43f5-a1b2-e0bcdfa87db2-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-f979d551-7642-43f5-a1b2-e0bcdfa87db2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "cinder-quobyte-f979d551-7642-43f5-a1b2-e0bcdfa87db2" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-quobyte-f979d551-7642-43f5-a1b2-e0bcdfa87db2" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e438cb8-de4c-46ec-9927-3756df5bcb9f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:02 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 is fetched for user f9c6e28879e144afadf1834b397384f3. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c55d600-b139-40a5-8e51-49a8a814cd7e]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:02 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 Jun 04 14:52:02 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:02 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD Jun 04 14:52:02 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:03 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:03 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-228486290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc46b0e-3054-42cc-a626-59535a608d15,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:00Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Creating volume cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:03 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2" returned: 0 in 0.883s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:03 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 1073741824 Jun 04 14:52:03 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:03 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2 Jun 04 14:52:03 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:04 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f979d551-7642-43f5-a1b2-e0bcdfa87db2" returned: 0 in 0.943s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-quobyte-f979d551-7642-43f5-a1b2-e0bcdfa87db2" released by "delete_volume" :: held 1.883s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Created reservations ['fcdd374d-184f-4849-8651-147a86c3dbf2', '5bd38dcc-76ca-48e9-964b-f3e75208dbac', '9e27d04d-12a2-432b-93e0-dd0031f9eb4d', 'dc71923c-c009-46ed-ac1d-1c32797c1698'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:04 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:04 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:04 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Acquiring lock "cinder-88a7bdc8-dd10-48ae-aba5-3d435eae8116-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 1073741824" returned: 0 in 1.449s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Lock "cinder-88a7bdc8-dd10-48ae-aba5-3d435eae8116-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Acquiring lock "cinder-quobyte-88a7bdc8-dd10-48ae-aba5-3d435eae8116" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:04 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Lock "cinder-quobyte-88a7bdc8-dd10-48ae-aba5-3d435eae8116" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:04 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[29812936-9cf9-4e65-bd50-1292e9339834]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:05 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 Jun 04 14:52:05 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:05 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.176s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:05 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:05 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Deleted volume successfully. Jun 04 14:52:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0802c5b7-3d57-4a47-8ec7-7b340bbcf214 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-f979d551-7642-43f5-a1b2-e0bcdfa87db2-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:06 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 0 in 1.323s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] <== create_volume: return (2916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.919s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Attempting download of d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume cdc46b0e-3054-42cc-a626-59535a608d15. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 14:52:06 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116" returned: 0 in 1.254s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9214891b-3d92-4a3c-88db-4cca98bb2da5]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:06 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116 Jun 04 14:52:06 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:06 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7 Jun 04 14:52:06 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:07 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7" returned: 0 in 0.849s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:07 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-88a7bdc8-dd10-48ae-aba5-3d435eae8116" returned: 0 in 0.931s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Lock "cinder-quobyte-88a7bdc8-dd10-48ae-aba5-3d435eae8116" released by "delete_volume" :: held 2.270s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Created reservations ['42beab12-e0ff-4565-ae70-a04a284dbeee', 'b177dee4-e324-43b5-a889-de3238a0b026', 'a8861880-c0e9-4f75-97ec-965a777d438c', 'f9ad6513-286b-47c6-a2f1-47a56a2006c0'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:07 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7 Jun 04 14:52:07 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:07 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:07 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:08 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7" returned: 1 in 0.962s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d02c254e-91bb-4869-903e-8451e5a50689_y1s8j8_7' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd415ab-b9ad-4a88-a303-96cdef371b08]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "cinder-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:08 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD Jun 04 14:52:08 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "cinder-quobyte-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:08 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.001s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:08 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Deleted volume successfully. Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-quobyte-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f" acquired by "delete_volume" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a476e309-9149-4ec0-a481-a12afb7c30a1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d6957a17-e8c8-4219-8bc0-c567dd1beaac tempest-VolumesTestJSON-2087393650 None] Lock "cinder-88a7bdc8-dd10-48ae-aba5-3d435eae8116-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:08 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f Jun 04 14:52:08 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:08 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] d02c254e-91bb-4869-903e-8451e5a50689 was qcow2, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 14:52:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:09 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:09 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:09 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f" returned: 0 in 0.880s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:09 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f Jun 04 14:52:09 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:10 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f" returned: 0 in 0.890s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-quobyte-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f" released by "delete_volume" :: held 1.825s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Created reservations ['dc1cdc9d-3112-4096-9963-a9cd11e90e84', '7cca95c0-c7e1-45b8-9863-f20246945d8a', 'e4bb410e-51b6-4994-a1bf-b57b65b1eea1', '70b77f6d-505c-4b26-be33-a9dd21990dc0'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:10 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:10 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:11 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.993s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:11 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Deleted volume successfully. Jun 04 14:52:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da257fb7-635c-4961-8ace-dfb5cd3ef6e4 tempest-VolumesTestJSON-2087393650 None] Lock "cinder-2fc5a1a9-51c5-4729-a69d-a3f2d577ca3f-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:11 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 0 in 2.962s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:11 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d02c254e-91bb-4869-903e-8451e5a50689_97xv1orbdevstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:52:11 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Converted 112.00 MB image at 37.80 MB/s Jun 04 14:52:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:11 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 1G Jun 04 14:52:11 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:13 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 1G" returned: 0 in 1.139s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04b114-ac2f-4415-a79f-0ce980e6818c]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:13 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:13 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:13 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:14 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:14 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:14 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 1 in 0.849s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Downloaded image d02c254e-91bb-4869-903e-8451e5a50689 ((None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}])) to volume cdc46b0e-3054-42cc-a626-59535a608d15 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Temporary image d02c254e-91bb-4869-903e-8451e5a50689 for user f9c6e28879e144afadf1834b397384f3 is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Marking volume cdc46b0e-3054-42cc-a626-59535a608d15 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:DELETE=11,cinder:UPDATE=113,cinder:SELECT=96,cinder:INSERT=24 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Copying metadata from image d02c254e-91bb-4869-903e-8451e5a50689 to cdc46b0e-3054-42cc-a626-59535a608d15. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Creating volume glance metadata for volume cdc46b0e-3054-42cc-a626-59535a608d15 backed by image d02c254e-91bb-4869-903e-8451e5a50689 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 14:52:14 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=128,cinder:SELECT=88,cinder:INSERT=32,cinder:DELETE=9 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:52:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8573fb99-703a-4518-bd2c-3afe8eb19759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc46b0e-3054-42cc-a626-59535a608d15', 'volume_size': 1, 'image_id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d02c254e-91bb-4869-903e-8451e5a50689', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d4261920dd141d5bbfa7ae5a52ef966', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd02c254e-91bb-4869-903e-8451e5a50689', 'created_at': datetime.datetime(2026, 6, 4, 12, 36, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 37, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d02c254e-91bb-4869-903e-8451e5a50689/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d0b837-e5b0-4d83-9959-a9523f0725c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Volume volume-cdc46b0e-3054-42cc-a626-59535a608d15 (cdc46b0e-3054-42cc-a626-59535a608d15): created successfully Jun 04 14:52:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d0b837-e5b0-4d83-9959-a9523f0725c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (ab4f16b1-519a-4b5b-aac3-7ea05bf23c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4beadfd3-dd15-48bd-9a27-76d978419114 tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:52:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1c88f1fe-1695-4bbc-bc67-15351f8ae5bf tempest-GroupSnapshotsTest-785075974 None] Group tempest-GroupSnapshotsTest-Group-1814865973: creating Jun 04 14:52:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1c88f1fe-1695-4bbc-bc67-15351f8ae5bf tempest-GroupSnapshotsTest-785075974 None] Group tempest-GroupSnapshotsTest-Group-1814865973: created successfully Jun 04 14:52:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1c88f1fe-1695-4bbc-bc67-15351f8ae5bf tempest-GroupSnapshotsTest-785075974 None] Create group completed successfully. Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (5f3410dd-d60b-4290-9c7e-f5d329b782ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2b715c-1888-4fa4-b714-34670a7ce1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2b715c-1888-4fa4-b714-34670a7ce1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1839882546',display_name='tempest-VolumesGetTest-Volume-734988241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fefd2c0-69ca-407d-9889-718bb65502a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:17Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be34ffe4-45df-4150-9d15-c43786c455f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be34ffe4-45df-4150-9d15-c43786c455f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee8cafa-a57d-45cd-9291-a667326b3879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee8cafa-a57d-45cd-9291-a667326b3879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fefd2c0-69ca-407d-9889-718bb65502a7', 'volume_name': 'volume-6fefd2c0-69ca-407d-9889-718bb65502a7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369defc7-c0bf-4bd6-a374-b38fdcd9368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369defc7-c0bf-4bd6-a374-b38fdcd9368e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877c9421-d3a2-476a-b87c-74d0682d05f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:16 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Volume 6fefd2c0-69ca-407d-9889-718bb65502a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fefd2c0-69ca-407d-9889-718bb65502a7', 'volume_size': 1} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1839882546',display_name='tempest-VolumesGetTest-Volume-734988241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fefd2c0-69ca-407d-9889-718bb65502a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f34cfc96f04b80b2f733edaaed0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:17Z,use_quota=True,user_id='f9c6e28879e144afadf1834b397384f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Creating volume 6fefd2c0-69ca-407d-9889-718bb65502a7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:16 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:16 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 1073741824 Jun 04 14:52:16 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (ad2fb64f-a4fe-4056-8e17-d7dda151cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43c19a8-17fe-4e86-bcd0-c0a29febe630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43c19a8-17fe-4e86-bcd0-c0a29febe630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088061423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a46fd908-84af-4b13-9e88-1161df3b6e2c,host='devstack@QuobyteHD#QuobyteHD',id=fafb7b6d-3d63-4bac-96bd-766ffa3e2f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:17Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af4ba97c-b1a6-4c0b-a112-e357a485370d),volume_type_id=af4ba97c-b1a6-4c0b-a112-e357a485370d)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ebe5c1-1190-4581-b9dd-733a88029098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ebe5c1-1190-4581-b9dd-733a88029098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb69a0-ac99-46e3-8ea6-bfac6d9c39b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb69a0-ac99-46e3-8ea6-bfac6d9c39b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fafb7b6d-3d63-4bac-96bd-766ffa3e2f51', 'volume_name': 'volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0eccd7-7c0b-4192-abe0-01de3767c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0eccd7-7c0b-4192-abe0-01de3767c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e977cd-2cc9-46a6-b99f-7c873d389b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Volume fafb7b6d-3d63-4bac-96bd-766ffa3e2f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51', 'volume_size': 1} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:17 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 1073741824" returned: 0 in 0.878s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:17 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 Jun 04 14:52:17 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:18 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7" returned: 0 in 1.090s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a46fd908-84af-4b13-9e88-1161df3b6e2c,created_at=2026-06-04T12:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088061423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a46fd908-84af-4b13-9e88-1161df3b6e2c,host='devstack@QuobyteHD#QuobyteHD',id=fafb7b6d-3d63-4bac-96bd-766ffa3e2f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:17Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af4ba97c-b1a6-4c0b-a112-e357a485370d),volume_type_id=af4ba97c-b1a6-4c0b-a112-e357a485370d)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Creating volume fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:18 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877c9421-d3a2-476a-b87c-74d0682d05f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fefd2c0-69ca-407d-9889-718bb65502a7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c25b3e-0914-45ba-97e8-29d9d160e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:19 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Volume volume-6fefd2c0-69ca-407d-9889-718bb65502a7 (6fefd2c0-69ca-407d-9889-718bb65502a7): created successfully Jun 04 14:52:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c25b3e-0914-45ba-97e8-29d9d160e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:19 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 1073741824 Jun 04 14:52:19 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Flow 'volume_create_manager' (5f3410dd-d60b-4290-9c7e-f5d329b782ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-90a91c1b-319e-40ff-b7f4-5cd93bdd3282 tempest-VolumesGetTest-1806513051 None] Created volume successfully. Jun 04 14:52:20 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 1073741824" returned: 0 in 1.046s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:20 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:20 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-6fefd2c0-69ca-407d-9889-718bb65502a7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Lock "cinder-6fefd2c0-69ca-407d-9889-718bb65502a7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-6fefd2c0-69ca-407d-9889-718bb65502a7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-6fefd2c0-69ca-407d-9889-718bb65502a7" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed7ada-3732-42b5-9b5d-f1f37d753099]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:20 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 Jun 04 14:52:20 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:21 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 1.017s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e977cd-2cc9-46a6-b99f-7c873d389b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f985177-8421-4d24-9367-895f9d5e8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:21 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Volume volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 (fafb7b6d-3d63-4bac-96bd-766ffa3e2f51): created successfully Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f985177-8421-4d24-9367-895f9d5e8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (ad2fb64f-a4fe-4056-8e17-d7dda151cb54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-867fc87e-836c-489d-8e21-7d4928473e3e tempest-GroupSnapshotsTest-785075974 None] Created volume successfully. Jun 04 14:52:21 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7" returned: 0 in 0.968s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:21 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7 Jun 04 14:52:21 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:22 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6fefd2c0-69ca-407d-9889-718bb65502a7" returned: 0 in 0.691s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-6fefd2c0-69ca-407d-9889-718bb65502a7" released by "delete_volume" :: held 1.740s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Created reservations ['acf5b769-620e-4608-8a9e-c3c83cedd6fe', '338bd6f6-15f0-468b-942f-df4f6ee3f98f', '01cd2f41-e9b1-484f-a862-c59a2806b1de', '39bf3a5a-ce24-419c-94ff-6b3879c01d1f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:22 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:22 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] GroupSnapshot 5da18908-3b4e-45d0-83e1-f56f8963104f: creating. Jun 04 14:52:22 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:22 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Group snapshot 5da18908-3b4e-45d0-83e1-f56f8963104f: creating. {{(pid=86522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Creating offline snapshot 72b740a5-d5a5-498e-97d7-a02c7da94acb of volume fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ff17a-e2a3-43a9-a3da-0d25830df7ca]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-cdc46b0e-3054-42cc-a626-59535a608d15-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Lock "cinder-cdc46b0e-3054-42cc-a626-59535a608d15-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:22 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:22 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Acquiring lock "cinder-quobyte-cdc46b0e-3054-42cc-a626-59535a608d15" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-cdc46b0e-3054-42cc-a626-59535a608d15" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125ccc2-f297-4306-8f12-677d4395aa2f]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:23 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:23 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:23 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.327s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:23 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.536s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:23 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:52:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-02140368-1439-4924-ae43-02892206135d tempest-VolumesGetTest-1806513051 None] Lock "cinder-6fefd2c0-69ca-407d-9889-718bb65502a7-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:23 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 1.415s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:24 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb 1G Jun 04 14:52:24 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:24 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 0 in 1.231s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:24 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:24 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:25 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb 1G" returned: 0 in 1.031s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:25 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb Jun 04 14:52:25 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:25 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 1 in 0.945s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:25 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15 Jun 04 14:52:25 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:25 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cdc46b0e-3054-42cc-a626-59535a608d15" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:25 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Lock "cinder-quobyte-cdc46b0e-3054-42cc-a626-59535a608d15" released by "delete_volume" :: held 3.037s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb" returned: 0 in 0.900s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:25 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:52:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:25 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb Jun 04 14:52:25 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Created reservations ['a57eb7bb-c915-4350-8a8e-3c0af3250173', '3e144b39-aae2-47cb-8132-bb456d4572d5', '34b85780-e554-4836-85b0-d13e13d304dc', '1c2a8879-e899-46c8-be89-7bff566f5d1d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:26 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:26 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:26 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb" returned: 0 in 0.813s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:26 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info Jun 04 14:52:26 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:27 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.810s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:27 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Deleted volume successfully. Jun 04 14:52:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7a59e5ca-7f02-4415-8a22-e5edc41ffae7 tempest-VolumesGetTest-1806513051 None] Lock "cinder-cdc46b0e-3054-42cc-a626-59535a608d15-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:27 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info" returned: 0 in 1.075s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:27 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:52:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:27 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info Jun 04 14:52:27 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:28 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.info" returned: 0 in 0.725s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.160s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f79bba75-9a18-4ecc-ac4a-fad501ff6a5c tempest-GroupSnapshotsTest-785075974 None] group_snapshot 5da18908-3b4e-45d0-83e1-f56f8963104f: created successfully Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-72b740a5-d5a5-498e-97d7-a02c7da94acb-08cd51a5-8483-483b-84e1-a604e1911d75" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-72b740a5-d5a5-498e-97d7-a02c7da94acb-08cd51a5-8483-483b-84e1-a604e1911d75" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Creating volume 08cd51a5-8483-483b-84e1-a604e1911d75 from snapshot 72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-08cd51a5-8483-483b-84e1-a604e1911d75" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-08cd51a5-8483-483b-84e1-a604e1911d75" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] snapshot: 72b740a5-d5a5-498e-97d7-a02c7da94acb, volume: 08cd51a5-8483-483b-84e1-a604e1911d75, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b0510b-c8bc-47ad-b8a9-7220f0ccc9a1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:30 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb Jun 04 14:52:30 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:32 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb" returned: 0 in 1.559s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:52:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:52:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:52:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd03bc9-0cd5-4209-9d88-ca3f781ec210]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:32 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:32 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:33 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 1.007s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:33 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:52:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:33 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 Jun 04 14:52:33 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:34 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-7bdbd4b7-2f63-43ac-abf1-9c9cda2f6c12 tempest-TestShelveInstance-859101957 None] Terminate volume connection completed successfully. Jun 04 14:52:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-7bdbd4b7-2f63-43ac-abf1-9c9cda2f6c12 tempest-TestShelveInstance-859101957 None] Deleting attachment 58db746c-a17c-4aed-9a92-896621b2a55d. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:52:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Acquiring lock "cinder-3721044a-53ab-429d-92a6-9212dc6c9756-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Lock "cinder-3721044a-53ab-429d-92a6-9212dc6c9756-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Acquiring lock "cinder-quobyte-3721044a-53ab-429d-92a6-9212dc6c9756" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Lock "cinder-quobyte-3721044a-53ab-429d-92a6-9212dc6c9756" acquired by "delete_volume" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:35 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f350e2-b302-494a-afce-d1a5635e9719]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:35 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:52:35 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Flow 'volume_create_manager' (e7f6e5fb-dfd2-462d-a7ea-98a60f17e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d88141-fc74-495a-b882-c9d1481baa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d88141-fc74-495a-b882-c9d1481baa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-286554577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be8ea91-685f-4cd4-9759-d0819b75527a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b564c93cc38643aba31b176c8e692ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:36Z,use_quota=True,user_id='a3f381d6588f416089527ba6f0505b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4aec3f5-97ee-4f2b-bbc3-d0b452a82269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4aec3f5-97ee-4f2b-bbc3-d0b452a82269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7f17e4-90ff-49cb-9be6-231c835085e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7f17e4-90ff-49cb-9be6-231c835085e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be8ea91-685f-4cd4-9759-d0819b75527a', 'volume_name': 'volume-5be8ea91-685f-4cd4-9759-d0819b75527a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76037fcd-2683-49cb-bc1d-abc36bab6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76037fcd-2683-49cb-bc1d-abc36bab6376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fac839-b039-4dbb-9ad2-e9c4f2a0b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:36 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Volume 5be8ea91-685f-4cd4-9759-d0819b75527a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be8ea91-685f-4cd4-9759-d0819b75527a', 'volume_size': 1} Jun 04 14:52:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:37 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 1.760s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:37 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:52:37 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:38 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 1 in 1.796s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:52:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:39 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756 Jun 04 14:52:39 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:39 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75" returned: 0 in 5.772s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:39 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8595b8d1-fe72-4c36-860a-90fde69d328b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:39 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:39 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:39 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3721044a-53ab-429d-92a6-9212dc6c9756" returned: 0 in 0.832s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Lock "cinder-quobyte-3721044a-53ab-429d-92a6-9212dc6c9756" released by "delete_volume" :: held 4.529s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:39 devstack cinder-volume[86522]: DEBUG cinder.quota [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Created reservations ['07a7ba4e-6474-4ae9-8c80-665cd3853bdc', 'f6aa120d-acd2-416b-9713-7f3a91999b0f', '57316e3c-5ea3-447f-9c02-bc9313ffb674', '1c778c1d-083b-4f06-997d-cd954aa51c79'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:40 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:40 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:40 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 1.186s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:52:40 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Converted 1024.00 MB image at 177.37 MB/s Jun 04 14:52:40 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:40 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 Jun 04 14:52:40 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:40 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.813s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.manager [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Deleted volume successfully. Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [req-64d1bad9-8f03-4639-890d-263f0e25f531 req-3d6a4210-f340-4abc-b710-f2f9f5be3f80 tempest-TestShelveInstance-859101957 None] Lock "cinder-3721044a-53ab-429d-92a6-9212dc6c9756-delete_volume" released by "delete_volume" :: held 5.775s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:40 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75" returned: 0 in 0.704s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-08cd51a5-8483-483b-84e1-a604e1911d75" released by "_copy_volume_from_snapshot" :: held 10.397s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-72b740a5-d5a5-498e-97d7-a02c7da94acb-08cd51a5-8483-483b-84e1-a604e1911d75" released by "_create_volume_from_snapshot" :: held 10.438s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.456s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.383s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-286554577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be8ea91-685f-4cd4-9759-d0819b75527a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b564c93cc38643aba31b176c8e692ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:36Z,use_quota=True,user_id='a3f381d6588f416089527ba6f0505b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Creating volume 5be8ea91-685f-4cd4-9759-d0819b75527a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:40 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:41 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a 1073741824 Jun 04 14:52:41 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9f506a74-2ebe-4295-a9f3-3099629ec52f tempest-GroupSnapshotsTest-785075974 None] Create group from source-snapshot-5da18908-3b4e-45d0-83e1-f56f8963104f completed successfully. Jun 04 14:52:41 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a 1073741824" returned: 0 in 0.925s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-08cd51a5-8483-483b-84e1-a604e1911d75" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-08cd51a5-8483-483b-84e1-a604e1911d75" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:42 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a Jun 04 14:52:42 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136b04f-251a-4236-9a35-223a1402168b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:42 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 Jun 04 14:52:42 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:42 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a" returned: 0 in 0.714s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fac839-b039-4dbb-9ad2-e9c4f2a0b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be8ea91-685f-4cd4-9759-d0819b75527a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e63d8-b92c-4416-8169-51f8c77b668b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Volume volume-5be8ea91-685f-4cd4-9759-d0819b75527a (5be8ea91-685f-4cd4-9759-d0819b75527a): created successfully Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e63d8-b92c-4416-8169-51f8c77b668b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Flow 'volume_create_manager' (e7f6e5fb-dfd2-462d-a7ea-98a60f17e807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b8088e1e-5556-492d-8ec7-db040fa00c2e tempest-VolumesListTestJSON-1301878519 None] Created volume successfully. Jun 04 14:52:42 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75" returned: 0 in 0.816s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:42 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75 Jun 04 14:52:42 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:43 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08cd51a5-8483-483b-84e1-a604e1911d75" returned: 0 in 0.666s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-08cd51a5-8483-483b-84e1-a604e1911d75" released by "delete_volume" :: held 1.564s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Flow 'volume_create_manager' (74904086-7a3b-434d-a683-3c87945ff3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3827968e-cb04-400c-baeb-4c85aba4f9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3827968e-cb04-400c-baeb-4c85aba4f9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-762784858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b996b693-526f-4550-9c2a-0fdb990a44bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b564c93cc38643aba31b176c8e692ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:43Z,use_quota=True,user_id='a3f381d6588f416089527ba6f0505b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cb47ba-0038-42f1-a5d1-43a562c64eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cb47ba-0038-42f1-a5d1-43a562c64eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34bef6d-4aac-4eea-8e8e-fba1a3ec2f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34bef6d-4aac-4eea-8e8e-fba1a3ec2f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b996b693-526f-4550-9c2a-0fdb990a44bd', 'volume_name': 'volume-b996b693-526f-4550-9c2a-0fdb990a44bd', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c298e94f-0b0f-4f5a-ae1e-dc1d1b0a0f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c298e94f-0b0f-4f5a-ae1e-dc1d1b0a0f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04647331-15dd-476a-9b5c-ba5c15a69126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:43 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Volume b996b693-526f-4550-9c2a-0fdb990a44bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b996b693-526f-4550-9c2a-0fdb990a44bd', 'volume_size': 1} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-762784858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b996b693-526f-4550-9c2a-0fdb990a44bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b564c93cc38643aba31b176c8e692ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:43Z,use_quota=True,user_id='a3f381d6588f416089527ba6f0505b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Creating volume b996b693-526f-4550-9c2a-0fdb990a44bd {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:43 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:43 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd 1073741824 Jun 04 14:52:43 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Created reservations ['5411aec9-6ff0-42a9-9d5a-13830a393114'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:43 devstack cinder-volume[86522]: WARNING cinder.quota [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-601857229 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-601857229, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:52:43 devstack cinder-volume[86522]: WARNING cinder.quota [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-601857229 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-601857229, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Created reservations ['bda649a7-b5f3-42e5-8529-d46d0fa128b2', '22dea45d-f5eb-48d3-b125-2baa8897c543', '5655a1f8-54e5-48b9-b728-564a0a6c4812', '34a31c24-10b5-421d-8721-91adbc1fed81'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:43 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:43 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] group_snapshot 5da18908-3b4e-45d0-83e1-f56f8963104f: deleting Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] group_snapshot 5da18908-3b4e-45d0-83e1-f56f8963104f: deleting {{(pid=86522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-72b740a5-d5a5-498e-97d7-a02c7da94acb" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-72b740a5-d5a5-498e-97d7-a02c7da94acb" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Deleting offline snapshot 72b740a5-d5a5-498e-97d7-a02c7da94acb of volume fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] snapshot_file for this snap is: volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[30877bb4-8d7e-414b-99e5-38e989d461ba]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:44 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.771s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fc703905-baac-4a37-9cb1-cbbb4e26c15e tempest-GroupSnapshotsTest-785075974 None] Delete group completed successfully. Jun 04 14:52:44 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb Jun 04 14:52:44 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:44 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd 1073741824" returned: 0 in 1.129s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:44 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd Jun 04 14:52:44 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:45 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb" returned: 0 in 0.978s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dd42ae-afdc-4c31-9b25-c3d55ca77132]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:45 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd" returned: 0 in 0.819s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04647331-15dd-476a-9b5c-ba5c15a69126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b996b693-526f-4550-9c2a-0fdb990a44bd', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24bc76f-30bf-44d7-adef-77eaa2588c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:45 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Volume volume-b996b693-526f-4550-9c2a-0fdb990a44bd (b996b693-526f-4550-9c2a-0fdb990a44bd): created successfully Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24bc76f-30bf-44d7-adef-77eaa2588c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Flow 'volume_create_manager' (74904086-7a3b-434d-a683-3c87945ff3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:45 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b9cd9939-60b5-47d6-aabd-d381e13fdec8 tempest-VolumesListTestJSON-1301878519 None] Created volume successfully. Jun 04 14:52:45 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:45 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:46 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 1.107s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:46 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb Jun 04 14:52:46 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Flow 'volume_create_manager' (7d89ec68-818a-44f6-9ebd-a2c5660cdebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b60fd5-a875-4112-8fda-1424a1a7a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b60fd5-a875-4112-8fda-1424a1a7a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2064912776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c886593-1a00-4ee0-b53e-88390a4aad9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b564c93cc38643aba31b176c8e692ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:48Z,use_quota=True,user_id='a3f381d6588f416089527ba6f0505b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e94bd2-ee94-4d00-a86d-1f7d6f4e5d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e94bd2-ee94-4d00-a86d-1f7d6f4e5d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7795a5b5-3881-4ee7-9072-e4fbdc98f682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7795a5b5-3881-4ee7-9072-e4fbdc98f682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c886593-1a00-4ee0-b53e-88390a4aad9a', 'volume_name': 'volume-0c886593-1a00-4ee0-b53e-88390a4aad9a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64b4825-76ee-43e2-af96-94fba6cbc3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64b4825-76ee-43e2-af96-94fba6cbc3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a17fc90-6017-46df-ba74-a7fb4692affe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:47 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Volume 0c886593-1a00-4ee0-b53e-88390a4aad9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c886593-1a00-4ee0-b53e-88390a4aad9a', 'volume_size': 1} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2064912776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c886593-1a00-4ee0-b53e-88390a4aad9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b564c93cc38643aba31b176c8e692ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:48Z,use_quota=True,user_id='a3f381d6588f416089527ba6f0505b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Creating volume 0c886593-1a00-4ee0-b53e-88390a4aad9a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:47 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:47 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a 1073741824 Jun 04 14:52:47 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:47 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb" returned: 0 in 1.178s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:47 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb Jun 04 14:52:47 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:48 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51.72b740a5-d5a5-498e-97d7-a02c7da94acb" returned: 0 in 0.918s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-72b740a5-d5a5-498e-97d7-a02c7da94acb" released by "_delete_snapshot" :: held 4.331s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" released by "delete_snapshot" :: held 4.383s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:48 devstack cinder-volume[86522]: WARNING cinder.quota [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-601857229 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-601857229, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:52:48 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['de1bc2a0-9923-470b-b01e-608e55954ee5', '0109a71b-7c5b-4a3a-aaee-4dc159e95d60', 'fc16a4cf-0a33-41d6-8f0a-8104737f22d0', '0816bed9-1f68-44c6-bd3f-27555204084d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:49 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a 1073741824" returned: 0 in 1.222s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:49 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7dfb5f07-a313-4f22-9249-87310873a165 tempest-GroupSnapshotsTest-785075974 None] group_snapshot 5da18908-3b4e-45d0-83e1-f56f8963104f: deleted successfully Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:49 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a Jun 04 14:52:49 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:49 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a" returned: 0 in 0.681s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a17fc90-6017-46df-ba74-a7fb4692affe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c886593-1a00-4ee0-b53e-88390a4aad9a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bcd151-3f71-4342-9398-5d2d463c9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:49 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Volume volume-0c886593-1a00-4ee0-b53e-88390a4aad9a (0c886593-1a00-4ee0-b53e-88390a4aad9a): created successfully Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bcd151-3f71-4342-9398-5d2d463c9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Flow 'volume_create_manager' (7d89ec68-818a-44f6-9ebd-a2c5660cdebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:49 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fdbeb1be-5de1-4416-9e5d-28d4f6f6b8c6 tempest-VolumesListTestJSON-1301878519 None] Created volume successfully. Jun 04 14:52:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:50 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be7326-ba18-4a6c-af53-590874526034]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:50 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:50 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:51 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 0.829s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:51 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51 Jun 04 14:52:51 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:51 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" returned: 0 in 0.742s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-fafb7b6d-3d63-4bac-96bd-766ffa3e2f51" released by "delete_volume" :: held 1.648s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:51 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['724e8536-fa29-44ee-ae24-b6c8938a131b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:51 devstack cinder-volume[86522]: WARNING cinder.db.sqlalchemy.api [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-601857229'] Jun 04 14:52:51 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['cff5a4da-704a-4d1d-b455-3ec34cbd8614', '255c516a-83cb-4b5d-a8df-bf676a085775', '25b4b381-9545-49c7-808b-89ae5d2b34b6', 'f45a00aa-c343-49aa-811a-98e32ef80bd0'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:52 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:52 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:53 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.916s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fbb181f3-a5de-411d-a31d-f52764644915 tempest-GroupSnapshotsTest-785075974 None] Delete group completed successfully. Jun 04 14:52:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d084da83-f325-4dfe-b373-eee2e216f57d tempest-GroupSnapshotsTest-785075974 None] Group tempest-GroupSnapshotsTest-Group-171138917: creating Jun 04 14:52:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d084da83-f325-4dfe-b373-eee2e216f57d tempest-GroupSnapshotsTest-785075974 None] Group tempest-GroupSnapshotsTest-Group-171138917: created successfully Jun 04 14:52:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d084da83-f325-4dfe-b373-eee2e216f57d tempest-GroupSnapshotsTest-785075974 None] Create group completed successfully. Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "cinder-0c886593-1a00-4ee0-b53e-88390a4aad9a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-0c886593-1a00-4ee0-b53e-88390a4aad9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "cinder-quobyte-0c886593-1a00-4ee0-b53e-88390a4aad9a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-quobyte-0c886593-1a00-4ee0-b53e-88390a4aad9a" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a4eab1-8c55-4c63-8115-b83ed77702b5]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:53 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a Jun 04 14:52:53 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:54 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a" returned: 0 in 0.758s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:54 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a Jun 04 14:52:54 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (99605a8a-d63d-4d2a-a813-ca7d29f2b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86a0be4-a2ab-4630-9d8e-4c9168e3f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86a0be4-a2ab-4630-9d8e-4c9168e3f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1935705688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572a8d91-4193-4365-b977-6d34f4468356,host='devstack@QuobyteHD#QuobyteHD',id=0c61ee40-0e7b-4376-b56d-d41ce79de368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:55Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aeed57c-4fe3-47a0-accd-6ddcd9233093),volume_type_id=5aeed57c-4fe3-47a0-accd-6ddcd9233093)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d4a25-bb28-4eab-be77-ea684125a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d4a25-bb28-4eab-be77-ea684125a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c5911c-417e-4949-9d35-a1597e958362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c5911c-417e-4949-9d35-a1597e958362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c61ee40-0e7b-4376-b56d-d41ce79de368', 'volume_name': 'volume-0c61ee40-0e7b-4376-b56d-d41ce79de368', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37101b3-4581-455d-b2b6-2dcb404c883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37101b3-4581-455d-b2b6-2dcb404c883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a8c88d-a59c-4e52-b4d1-61fd193a2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:54 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Volume 0c61ee40-0e7b-4376-b56d-d41ce79de368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c61ee40-0e7b-4376-b56d-d41ce79de368', 'volume_size': 1} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=572a8d91-4193-4365-b977-6d34f4468356,created_at=2026-06-04T12:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1935705688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572a8d91-4193-4365-b977-6d34f4468356,host='devstack@QuobyteHD#QuobyteHD',id=0c61ee40-0e7b-4376-b56d-d41ce79de368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:55Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aeed57c-4fe3-47a0-accd-6ddcd9233093),volume_type_id=5aeed57c-4fe3-47a0-accd-6ddcd9233093)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Creating volume 0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:54 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:54 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 1073741824 Jun 04 14:52:54 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:55 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c886593-1a00-4ee0-b53e-88390a4aad9a" returned: 0 in 0.740s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-quobyte-0c886593-1a00-4ee0-b53e-88390a4aad9a" released by "delete_volume" :: held 1.562s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Created reservations ['0a58be99-4a9e-43d5-bd41-c1898e9c93e2', '3f0751f8-751e-4044-a713-f909a76d374b', '3fb98ab7-3c9e-475f-a975-93e625a5f34a', '24ee1413-5518-4af3-8f98-7fa61df53024'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:55 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:55 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:55 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-eb68183b-49e6-43d7-962c-3feeb3fe83f6 req-a18bdca5-2326-4a52-acd0-feb2d6be3cbb tempest-AttachVolumeNegativeTest-1284004915 None] Terminate volume connection completed successfully. Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-eb68183b-49e6-43d7-962c-3feeb3fe83f6 req-a18bdca5-2326-4a52-acd0-feb2d6be3cbb tempest-AttachVolumeNegativeTest-1284004915 None] Deleting attachment f61b41a3-abb1-486c-85dc-008239189912. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:52:55 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 1073741824" returned: 0 in 0.968s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "cinder-b996b693-526f-4550-9c2a-0fdb990a44bd-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-b996b693-526f-4550-9c2a-0fdb990a44bd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:55 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 Jun 04 14:52:55 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "cinder-quobyte-b996b693-526f-4550-9c2a-0fdb990a44bd" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-quobyte-b996b693-526f-4550-9c2a-0fdb990a44bd" acquired by "delete_volume" :: waited 0.039s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f393e96b-5534-457e-8901-1e768b26f937]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:56 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.815s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:56 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Deleted volume successfully. Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-025a96fa-36e3-45ed-ac07-66141a4e006f tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-0c886593-1a00-4ee0-b53e-88390a4aad9a-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:56 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd Jun 04 14:52:56 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:56 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368" returned: 0 in 0.758s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a8c88d-a59c-4e52-b4d1-61fd193a2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c61ee40-0e7b-4376-b56d-d41ce79de368', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b4b7b1-72f4-4a90-b412-9d2e5f75b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:56 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Volume volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 (0c61ee40-0e7b-4376-b56d-d41ce79de368): created successfully Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b4b7b1-72f4-4a90-b412-9d2e5f75b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (99605a8a-d63d-4d2a-a813-ca7d29f2b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:56 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1c6988fa-cd29-4958-bfa9-72c0b8064f15 tempest-GroupSnapshotsTest-785075974 None] Created volume successfully. Jun 04 14:52:56 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd" returned: 0 in 0.845s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:56 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd Jun 04 14:52:56 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:57 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b996b693-526f-4550-9c2a-0fdb990a44bd" returned: 0 in 0.725s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-quobyte-b996b693-526f-4550-9c2a-0fdb990a44bd" released by "delete_volume" :: held 1.650s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (af33e6eb-d78e-4e9c-8915-8dc50e87828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3b7adb-7367-481a-91c6-67fb5f687420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3b7adb-7367-481a-91c6-67fb5f687420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1414670948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572a8d91-4193-4365-b977-6d34f4468356,host='devstack@QuobyteHD#QuobyteHD',id=e9d38c82-70eb-43e6-8137-5a7136a1e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:58Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aeed57c-4fe3-47a0-accd-6ddcd9233093),volume_type_id=5aeed57c-4fe3-47a0-accd-6ddcd9233093)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890a878c-d1dd-4713-8ca2-a10649d58cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890a878c-d1dd-4713-8ca2-a10649d58cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cea174f-6a93-4e82-af02-2f5713937c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cea174f-6a93-4e82-af02-2f5713937c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d38c82-70eb-43e6-8137-5a7136a1e59b', 'volume_name': 'volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4191260-d3af-4286-bc0d-1981f931ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4191260-d3af-4286-bc0d-1981f931ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15503716-7615-44ae-81d2-95f752ef30e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:52:57 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Volume e9d38c82-70eb-43e6-8137-5a7136a1e59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b', 'volume_size': 1} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=572a8d91-4193-4365-b977-6d34f4468356,created_at=2026-06-04T12:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1414670948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=572a8d91-4193-4365-b977-6d34f4468356,host='devstack@QuobyteHD#QuobyteHD',id=e9d38c82-70eb-43e6-8137-5a7136a1e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:52:58Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5aeed57c-4fe3-47a0-accd-6ddcd9233093),volume_type_id=5aeed57c-4fe3-47a0-accd-6ddcd9233093)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Creating volume e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:52:57 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Created reservations ['ec43ed08-6da8-44a2-a92e-ed24109c5a82', '1e29eab6-b735-42b7-8732-e3a01b10afa0', 'a77ffef7-b2d7-45b7-b454-d106ffa4d6a6', '99165df3-2d10-426e-8fa9-dc30913a1a80'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:52:57 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b 1073741824 Jun 04 14:52:57 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:52:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:57 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:52:57 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "cinder-5be8ea91-685f-4cd4-9759-d0819b75527a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-5be8ea91-685f-4cd4-9759-d0819b75527a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "cinder-quobyte-5be8ea91-685f-4cd4-9759-d0819b75527a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-quobyte-5be8ea91-685f-4cd4-9759-d0819b75527a" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558ed54-0dab-4026-997b-3aa669e68513]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:58 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a Jun 04 14:52:58 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:58 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.795s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:52:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Deleted volume successfully. Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1ceabed8-ce33-463b-8dfe-da8e2b5de4df tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-b996b693-526f-4550-9c2a-0fdb990a44bd-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:52:58 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b 1073741824" returned: 0 in 1.017s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:58 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b Jun 04 14:52:58 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:52:59 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jun 04 14:52:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a" returned: 0 in 1.299s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:52:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:52:59 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a Jun 04 14:52:59 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:00 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b" returned: 0 in 1.220s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15503716-7615-44ae-81d2-95f752ef30e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a35ff1-c4d8-49b6-90c0-8e272390feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Volume volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b (e9d38c82-70eb-43e6-8137-5a7136a1e59b): created successfully Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a35ff1-c4d8-49b6-90c0-8e272390feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (af33e6eb-d78e-4e9c-8915-8dc50e87828f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:53:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2c63e8b5-2b83-400a-8500-b37de666afa6 tempest-GroupSnapshotsTest-785075974 None] Created volume successfully. Jun 04 14:53:00 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5be8ea91-685f-4cd4-9759-d0819b75527a" returned: 0 in 0.865s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-quobyte-5be8ea91-685f-4cd4-9759-d0819b75527a" released by "delete_volume" :: held 2.219s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Created reservations ['e3b34e4f-48bb-4887-8e21-eda61fdd82b4', '7f58890f-b2cc-4f08-9a5a-4521d27eb4bd', '0d231482-cf10-4444-870a-95254e5e3c8f', '1b64c2b0-8fe7-4256-87d5-17c0357a67f6'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:00 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:53:00 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f7ef49ec-e251-49ee-895a-3bac210b9059 tempest-GroupSnapshotsTest-785075974 None] Update group completed successfully. Jun 04 14:53:01 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.913s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:01 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:53:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Deleted volume successfully. Jun 04 14:53:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ead7455b-80ef-47ef-b3ae-162efc873718 tempest-VolumesListTestJSON-1301878519 None] Lock "cinder-5be8ea91-685f-4cd4-9759-d0819b75527a-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:02 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dfbcc1f0-0f60-4d7b-93cb-c7fcd9b6ff66 tempest-GroupSnapshotsTest-785075974 None] Update group completed successfully. Jun 04 14:53:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-71ca2a55-5a5c-4b98-b8fc-e029f9f09479 tempest-GroupSnapshotsTest-785075974 None] Update group completed successfully. Jun 04 14:53:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-09865c90-d8bc-4d48-8781-1ee137e07fff tempest-GroupSnapshotsTest-785075974 None] Update group completed successfully. Jun 04 14:53:06 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] GroupSnapshot 7d8680e1-9a7d-4e1f-a5d4-c53507769d12: creating. Jun 04 14:53:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Group snapshot 7d8680e1-9a7d-4e1f-a5d4-c53507769d12: creating. {{(pid=86522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 04 14:53:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Creating offline snapshot 59441a29-b318-4579-a8c7-74b9d0d9e3c8 of volume 0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:53:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0480820d-69b0-44a4-b534-11c5ef657408]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:06 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 Jun 04 14:53:06 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:07 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368" returned: 0 in 0.903s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:07 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 1G Jun 04 14:53:07 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:08 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 1G" returned: 0 in 0.866s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:08 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 Jun 04 14:53:08 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:09 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8" returned: 0 in 0.739s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:09 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:53:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:09 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 Jun 04 14:53:09 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:09 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8" returned: 0 in 0.644s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:09 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info Jun 04 14:53:09 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:10 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info" returned: 0 in 0.651s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:10 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:53:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:10 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info Jun 04 14:53:10 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:11 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.info" returned: 0 in 0.773s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.680s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Creating offline snapshot e8bc706f-2587-4036-aa50-dc0a628c0717 of volume e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5d993-0098-44f1-baeb-fb053f5b654f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:11 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b Jun 04 14:53:11 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:12 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b" returned: 0 in 0.827s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:12 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 1G Jun 04 14:53:12 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:13 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 1G" returned: 0 in 0.986s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:13 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 Jun 04 14:53:13 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:14 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717" returned: 0 in 0.919s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:14 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:53:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:14 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 Jun 04 14:53:14 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:14 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717" returned: 0 in 0.770s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:14 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info Jun 04 14:53:14 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:15 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info" returned: 0 in 0.697s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:15 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:53:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:15 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info Jun 04 14:53:15 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:16 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.info" returned: 0 in 0.755s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.068s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:16 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=104,cinder:INSERT=21,cinder:UPDATE=111,cinder:DELETE=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:53:16 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=104,cinder:INSERT=39,cinder:UPDATE=106,cinder:DELETE=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:53:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a22da07c-eecc-44f9-8988-a2e11af30b59 tempest-GroupSnapshotsTest-785075974 None] group_snapshot 7d8680e1-9a7d-4e1f-a5d4-c53507769d12: created successfully Jun 04 14:53:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] group_snapshot 7d8680e1-9a7d-4e1f-a5d4-c53507769d12: deleting Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] group_snapshot 7d8680e1-9a7d-4e1f-a5d4-c53507769d12: deleting {{(pid=86522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-0c61ee40-0e7b-4376-b56d-d41ce79de368" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-0c61ee40-0e7b-4376-b56d-d41ce79de368" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-59441a29-b318-4579-a8c7-74b9d0d9e3c8" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-59441a29-b318-4579-a8c7-74b9d0d9e3c8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Deleting offline snapshot 59441a29-b318-4579-a8c7-74b9d0d9e3c8 of volume 0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] snapshot_file for this snap is: volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[40802a4d-0a61-4474-81e8-883a0c058de0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:17 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 Jun 04 14:53:17 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:18 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c61ee40-0e7b-4376-b56d-d41ce79de368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:53:18 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d74c21-ed2f-4381-b4ad-82ca4a27c35f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:18 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 Jun 04 14:53:18 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:19 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368" returned: 0 in 0.889s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:19 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 Jun 04 14:53:19 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:20 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8" returned: 0 in 0.840s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:20 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8 Jun 04 14:53:20 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:20 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368.59441a29-b318-4579-a8c7-74b9d0d9e3c8" returned: 0 in 0.673s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-59441a29-b318-4579-a8c7-74b9d0d9e3c8" released by "_delete_snapshot" :: held 3.422s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-0c61ee40-0e7b-4376-b56d-d41ce79de368" released by "delete_snapshot" :: held 3.457s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-e9d38c82-70eb-43e6-8137-5a7136a1e59b" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-e9d38c82-70eb-43e6-8137-5a7136a1e59b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-e8bc706f-2587-4036-aa50-dc0a628c0717" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-e8bc706f-2587-4036-aa50-dc0a628c0717" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Deleting offline snapshot e8bc706f-2587-4036-aa50-dc0a628c0717 of volume e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:53:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] snapshot_file for this snap is: volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:53:21 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e126937-e492-4030-9ecd-3c0bdb49d9d9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:21 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 Jun 04 14:53:21 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:53:22 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Flow 'volume_create_manager' (6f3502bf-1294-4cc9-a598-a353b3e2ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8764217a-0a46-4102-b792-2afae0fd7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717" returned: 0 in 1.099s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8764217a-0a46-4102-b792-2afae0fd7de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-65180332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f87d3fb-33c9-4ff1-9020-5782db5e777d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae103c30e1704d8198504b24f79e6ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:53:22Z,use_quota=True,user_id='31ab80c105f24d589c11f52351930240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eede2a94-f342-4b3a-828f-7a25bedfb32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eede2a94-f342-4b3a-828f-7a25bedfb32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ca957d-126a-4a0a-a7d8-e2044c2653c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ca957d-126a-4a0a-a7d8-e2044c2653c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f87d3fb-33c9-4ff1-9020-5782db5e777d', 'volume_name': 'volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb0fc70-48ad-46be-80ea-61fca4a46b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb0fc70-48ad-46be-80ea-61fca4a46b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f979aa3-75ae-4c4d-940f-3fb0bc6e94bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:22 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Volume 9f87d3fb-33c9-4ff1-9020-5782db5e777d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d', 'volume_size': 1} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-65180332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f87d3fb-33c9-4ff1-9020-5782db5e777d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae103c30e1704d8198504b24f79e6ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:53:22Z,use_quota=True,user_id='31ab80c105f24d589c11f52351930240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Creating volume 9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:53:22 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a258df-f786-4fc1-a814-a22ca0fb60d0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:53:22 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d 1073741824 Jun 04 14:53:22 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:22 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:53:22 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:22 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b Jun 04 14:53:22 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:23 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.863s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:53:23 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b" returned: 0 in 1.083s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:23 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 Jun 04 14:53:23 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:23 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d 1073741824" returned: 0 in 1.302s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:23 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:53:23 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:24 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 0.816s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:24 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717" returned: 0 in 1.102s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f979aa3-75ae-4c4d-940f-3fb0bc6e94bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:24 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717 Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a4e8bd-5305-4126-bf1d-0c81565913c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:24 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:24 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Volume volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d (9f87d3fb-33c9-4ff1-9020-5782db5e777d): created successfully Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a4e8bd-5305-4126-bf1d-0c81565913c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Flow 'volume_create_manager' (6f3502bf-1294-4cc9-a598-a353b3e2ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:53:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dbf4b098-f27a-492a-815d-01782dc98d8d tempest-TestStampPattern-24935867 None] Created volume successfully. Jun 04 14:53:25 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b.e8bc706f-2587-4036-aa50-dc0a628c0717" returned: 0 in 0.709s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-e8bc706f-2587-4036-aa50-dc0a628c0717" released by "_delete_snapshot" :: held 4.250s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-e9d38c82-70eb-43e6-8137-5a7136a1e59b" released by "delete_snapshot" :: held 4.276s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:25 devstack cinder-volume[86522]: WARNING cinder.quota [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-338700289 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-338700289, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:53:25 devstack cinder-volume[86522]: WARNING cinder.quota [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-338700289 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-338700289, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:53:25 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Created reservations ['0a146461-5e0a-4ae1-8cd8-7b999fb11c18', '7aa7d92f-aac9-436c-95b2-e7f2c0fccc0c', 'e9cb3a08-a096-416f-acb8-1793dd861fc3', '70e66708-a9b9-4795-bb15-0b464c941772'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:25 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] Created reservations ['99f128a9-e25f-48f9-85af-505065f4fc02', '618ea7c6-744e-4180-ae09-674a76006803', '3b9cf08e-7e3e-4af1-b59d-89b33aa4077c', '62eaa12c-929a-4b5d-a2be-4d07f77f856b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4221aad5-3142-4e1d-b445-1fe8c45f6f8b tempest-GroupSnapshotsTest-785075974 None] group_snapshot 7d8680e1-9a7d-4e1f-a5d4-c53507769d12: deleted successfully Jun 04 14:53:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-0c61ee40-0e7b-4376-b56d-d41ce79de368" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-0c61ee40-0e7b-4376-b56d-d41ce79de368" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[29864a54-951e-4643-bc5c-ae257817b97d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:26 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 Jun 04 14:53:26 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:27 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368" returned: 0 in 0.825s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:27 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368 Jun 04 14:53:27 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:28 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c61ee40-0e7b-4376-b56d-d41ce79de368" returned: 0 in 1.028s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-0c61ee40-0e7b-4376-b56d-d41ce79de368" released by "delete_volume" :: held 2.009s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-e9d38c82-70eb-43e6-8137-5a7136a1e59b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-e9d38c82-70eb-43e6-8137-5a7136a1e59b" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39fb1d-520b-49ee-bd1e-b6eb2a75361c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:28 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b Jun 04 14:53:28 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:29 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b" returned: 0 in 0.936s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:29 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b Jun 04 14:53:29 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:30 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d38c82-70eb-43e6-8137-5a7136a1e59b" returned: 0 in 0.845s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-e9d38c82-70eb-43e6-8137-5a7136a1e59b" released by "delete_volume" :: held 1.873s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['fcd00292-8bd9-4d64-8c28-74f45ad7ed10'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:30 devstack cinder-volume[86522]: WARNING cinder.quota [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-338700289 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-338700289, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['6c6c80dd-2475-440c-8a1e-dc907a4089a0', '6a629c17-e957-48ac-9eac-efdb2ed4b821', '85d863f0-6a0b-4a15-82b7-9d443a41c1a5', 'c96cf4bf-0010-4e59-84ef-67f426f78e64'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['f98146d5-1452-40ab-bb53-a181a9e88de4', 'abffdc51-d6b8-4ba3-bec4-f79fabffe19b', '41c9c3d6-595f-4d6a-a3ef-d5747e1c51d1', 'f0abf39f-817d-4a2a-99cb-6021f922a1c5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:30 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:53:30 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:31 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.721s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:53:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6e4fefc9-a46e-44b6-8ac8-79cf7a8a3b62 tempest-GroupSnapshotsTest-785075974 None] Delete group completed successfully. Jun 04 14:53:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d942966e-1afc-4ef6-8b30-37e4986207ce tempest-GroupSnapshotsTest-785075974 None] Group tempest-GroupSnapshotsTest-Group-886554233: creating Jun 04 14:53:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d942966e-1afc-4ef6-8b30-37e4986207ce tempest-GroupSnapshotsTest-785075974 None] Group tempest-GroupSnapshotsTest-Group-886554233: created successfully Jun 04 14:53:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d942966e-1afc-4ef6-8b30-37e4986207ce tempest-GroupSnapshotsTest-785075974 None] Create group completed successfully. Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (2d9f2f62-3371-439f-ab94-3102b80d81e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73052c3d-ed35-4cb0-9000-14f8c6a844d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73052c3d-ed35-4cb0-9000-14f8c6a844d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393583898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84721188-82ab-4cc9-8eb5-ffa6748629b6,host='devstack@QuobyteHD#QuobyteHD',id=7562db06-3784-41e1-9c8e-d0f6c396c50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:53:33Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2c188fd-7b00-4646-820a-8aa860b42df9),volume_type_id=e2c188fd-7b00-4646-820a-8aa860b42df9)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fa0bd3-b727-4c8b-a2fa-2aa66b52a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fa0bd3-b727-4c8b-a2fa-2aa66b52a77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b453404-2c5b-4899-a749-348c6acfb138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b453404-2c5b-4899-a749-348c6acfb138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7562db06-3784-41e1-9c8e-d0f6c396c50b', 'volume_name': 'volume-7562db06-3784-41e1-9c8e-d0f6c396c50b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb4d22e-893b-44cc-a2c1-85a0c41078bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb4d22e-893b-44cc-a2c1-85a0c41078bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f20a81-e6d1-46c6-8a4c-a6d9f10411c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Volume 7562db06-3784-41e1-9c8e-d0f6c396c50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7562db06-3784-41e1-9c8e-d0f6c396c50b', 'volume_size': 1} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84721188-82ab-4cc9-8eb5-ffa6748629b6,created_at=2026-06-04T12:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393583898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84721188-82ab-4cc9-8eb5-ffa6748629b6,host='devstack@QuobyteHD#QuobyteHD',id=7562db06-3784-41e1-9c8e-d0f6c396c50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f89156883e174b29812dfefe8c1af064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:53:33Z,use_quota=True,user_id='ad64cd20c4e64a1aab286856fb800902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2c188fd-7b00-4646-820a-8aa860b42df9),volume_type_id=e2c188fd-7b00-4646-820a-8aa860b42df9)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Creating volume 7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:53:33 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:53:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:33 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b 1073741824 Jun 04 14:53:33 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:34 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b 1073741824" returned: 0 in 0.978s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:34 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b Jun 04 14:53:34 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:35 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b" returned: 0 in 0.726s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f20a81-e6d1-46c6-8a4c-a6d9f10411c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7562db06-3784-41e1-9c8e-d0f6c396c50b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1392b2e-723c-403b-9bff-235b8a976316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:53:35 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Volume volume-7562db06-3784-41e1-9c8e-d0f6c396c50b (7562db06-3784-41e1-9c8e-d0f6c396c50b): created successfully Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1392b2e-723c-403b-9bff-235b8a976316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Flow 'volume_create_manager' (2d9f2f62-3371-439f-ab94-3102b80d81e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:53:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0fe1bd62-6509-42cc-8d24-760e9d4d57da tempest-GroupSnapshotsTest-785075974 None] Created volume successfully. Jun 04 14:53:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] GroupSnapshot a4001bda-d451-4ef5-a87d-d1abd65de6ce: creating. Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Group snapshot a4001bda-d451-4ef5-a87d-d1abd65de6ce: creating. {{(pid=86522) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Creating offline snapshot db7ceeee-493c-4f90-8474-1d36d6337e75 of volume 7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e82b6-66c0-4de1-85ef-ce3583752aea]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:36 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b Jun 04 14:53:36 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:36 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b" returned: 0 in 0.864s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:36 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 1G Jun 04 14:53:36 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:37 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 1G" returned: 0 in 0.880s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7562db06-3784-41e1-9c8e-d0f6c396c50b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:37 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7562db06-3784-41e1-9c8e-d0f6c396c50b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 Jun 04 14:53:37 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:39 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7562db06-3784-41e1-9c8e-d0f6c396c50b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75" returned: 0 in 1.487s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:39 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:53:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:39 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 Jun 04 14:53:39 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:40 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75" returned: 0 in 1.231s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:40 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info Jun 04 14:53:40 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:41 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info" returned: 0 in 0.996s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:41 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:53:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:41 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info Jun 04 14:53:41 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:42 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.info" returned: 0 in 0.757s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.333s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1162820d-6d04-4690-bb78-9364255e3833 tempest-GroupSnapshotsTest-785075974 None] group_snapshot a4001bda-d451-4ef5-a87d-d1abd65de6ce: created successfully Jun 04 14:53:43 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] group_snapshot a4001bda-d451-4ef5-a87d-d1abd65de6ce: deleting Jun 04 14:53:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] group_snapshot a4001bda-d451-4ef5-a87d-d1abd65de6ce: deleting {{(pid=86522) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-7562db06-3784-41e1-9c8e-d0f6c396c50b" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-7562db06-3784-41e1-9c8e-d0f6c396c50b" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-db7ceeee-493c-4f90-8474-1d36d6337e75" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-db7ceeee-493c-4f90-8474-1d36d6337e75" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Deleting offline snapshot db7ceeee-493c-4f90-8474-1d36d6337e75 of volume 7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] snapshot_file for this snap is: volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a5f266-4d22-45e6-b22e-b80d9072cf8a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:44 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 Jun 04 14:53:44 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75" returned: 0 in 1.257s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7562db06-3784-41e1-9c8e-d0f6c396c50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:53:45 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8fbd64-7529-42ce-a271-0fdb7bb3715c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:45 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b Jun 04 14:53:45 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:47 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b" returned: 0 in 1.718s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:47 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 Jun 04 14:53:47 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:48 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75" returned: 0 in 1.606s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:48 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75 Jun 04 14:53:48 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:49 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b.db7ceeee-493c-4f90-8474-1d36d6337e75" returned: 0 in 0.899s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-db7ceeee-493c-4f90-8474-1d36d6337e75" released by "_delete_snapshot" :: held 5.782s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-7562db06-3784-41e1-9c8e-d0f6c396c50b" released by "delete_snapshot" :: held 5.837s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:50 devstack cinder-volume[86522]: WARNING cinder.quota [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-847788611 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-847788611, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:53:50 devstack cinder-volume[86522]: WARNING cinder.quota [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-847788611 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-847788611, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:53:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] Created reservations ['a8a2d1fa-d2cf-4f0f-bc82-4f88c8f84395', '30cd2c84-bfc0-4f7c-9f46-4049eb61796f', 'd366a447-5092-4433-8091-0cddf9d8de02', 'afef6d9a-611c-4a5c-bdfd-2cbb391cffca'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:50 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-33dd9aee-f88b-4f77-83cc-73e0f8a47770 tempest-GroupSnapshotsTest-785075974 None] group_snapshot a4001bda-d451-4ef5-a87d-d1abd65de6ce: deleted successfully Jun 04 14:53:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "cinder-quobyte-7562db06-3784-41e1-9c8e-d0f6c396c50b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:53:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-7562db06-3784-41e1-9c8e-d0f6c396c50b" acquired by "delete_volume" :: waited 0.040s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:53:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d0952-135b-4036-b005-18104861b0da]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:53:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:52 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b Jun 04 14:53:52 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:53 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b" returned: 0 in 2.087s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:53 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b Jun 04 14:53:53 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:54 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-7562db06-3784-41e1-9c8e-d0f6c396c50b" returned: 0 in 0.773s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Lock "cinder-quobyte-7562db06-3784-41e1-9c8e-d0f6c396c50b" released by "delete_volume" :: held 2.991s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Created reservations ['4a2f9098-6c31-4d6c-a246-38ca3f3d8851'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:54 devstack cinder-volume[86522]: WARNING cinder.quota [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-847788611 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-847788611, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Created reservations ['6bff11c7-433f-45d0-946b-8a12bd06f8d2', '8fd4999a-46c5-4c32-a2c9-740802bf72b0', 'bdbf8dce-48ce-4c31-b2dc-5b671f8f6268', '97692d42-c4ad-46a5-adc5-db7a0cb18475'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:53:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:53:54 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:53:54 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:53:55 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jun 04 14:53:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.667s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:53:55 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:53:55 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6c7e6dee-81e7-47dc-bbff-34e56b754d7c tempest-GroupSnapshotsTest-785075974 None] Delete group completed successfully. Jun 04 14:54:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-34a2af4d-e862-45c8-b727-2f393e0c8ac1 tempest-GroupsV314Test-1876964752 None] Group tempest-GroupsV314Test-Group-201213930: creating Jun 04 14:54:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-34a2af4d-e862-45c8-b727-2f393e0c8ac1 tempest-GroupsV314Test-1876964752 None] Group tempest-GroupsV314Test-Group-201213930: created successfully Jun 04 14:54:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-34a2af4d-e862-45c8-b727-2f393e0c8ac1 tempest-GroupsV314Test-1876964752 None] Create group completed successfully. Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Flow 'volume_create_manager' (2ca4ae4b-8458-4d2b-be0d-729b136ba04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717723c1-d644-46a8-b427-50870266736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717723c1-d644-46a8-b427-50870266736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-735278097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6aea8bf-8f3a-4ddf-8ec1-dfa91c61d3b7,host='devstack@QuobyteHD#QuobyteHD',id=a16da699-cf75-4a99-a6b1-0e10465fd010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3760e857b8f4a7a9fa3f59037ed5e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:03Z,use_quota=True,user_id='8b973ed3669d44d59a89bb895bf0b567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d6e701e-da8c-4903-8ca3-4953701a2b7d),volume_type_id=6d6e701e-da8c-4903-8ca3-4953701a2b7d)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd4f011-c585-4858-acd0-7547a3b3d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd4f011-c585-4858-acd0-7547a3b3d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e0b8e6-b6aa-46c8-890e-ccb47255ce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e0b8e6-b6aa-46c8-890e-ccb47255ce83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16da699-cf75-4a99-a6b1-0e10465fd010', 'volume_name': 'volume-a16da699-cf75-4a99-a6b1-0e10465fd010', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a2cbe3-9726-4ee4-a7e1-6d0f9fe6c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a2cbe3-9726-4ee4-a7e1-6d0f9fe6c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc23903-085f-4aa6-b2d3-016c35853e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:02 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Volume a16da699-cf75-4a99-a6b1-0e10465fd010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16da699-cf75-4a99-a6b1-0e10465fd010', 'volume_size': 1} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6aea8bf-8f3a-4ddf-8ec1-dfa91c61d3b7,created_at=2026-06-04T12:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-735278097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6aea8bf-8f3a-4ddf-8ec1-dfa91c61d3b7,host='devstack@QuobyteHD#QuobyteHD',id=a16da699-cf75-4a99-a6b1-0e10465fd010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3760e857b8f4a7a9fa3f59037ed5e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:03Z,use_quota=True,user_id='8b973ed3669d44d59a89bb895bf0b567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d6e701e-da8c-4903-8ca3-4953701a2b7d),volume_type_id=6d6e701e-da8c-4903-8ca3-4953701a2b7d)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Creating volume a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:54:02 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:54:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:02 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 1073741824 Jun 04 14:54:02 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Flow 'volume_create_manager' (aceb6e25-0e3b-4bde-8809-6336daf45080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e24505-d42b-41ca-89fa-13bc3746814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:03 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 1073741824" returned: 0 in 1.019s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e24505-d42b-41ca-89fa-13bc3746814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-161530398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08429930-e98f-415f-945c-b93223159bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9860546ba2d642a79c2d963dcbb096f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:04Z,use_quota=True,user_id='5d8f29d3e41741638238a7ac3ebe4922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8c9a27-9a6d-417f-8028-61618135f20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8c9a27-9a6d-417f-8028-61618135f20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a69a57-5118-47ec-9663-35d242c17b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a69a57-5118-47ec-9663-35d242c17b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08429930-e98f-415f-945c-b93223159bc1', 'volume_name': 'volume-08429930-e98f-415f-945c-b93223159bc1', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f66da1-7069-4b3b-ba12-0b4809137429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f66da1-7069-4b3b-ba12-0b4809137429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7404e6-a512-4889-9c25-7f666a934d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:03 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Volume 08429930-e98f-415f-945c-b93223159bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08429930-e98f-415f-945c-b93223159bc1', 'volume_size': 1} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:03 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:03 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:04 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.652s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-161530398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08429930-e98f-415f-945c-b93223159bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9860546ba2d642a79c2d963dcbb096f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:04Z,use_quota=True,user_id='5d8f29d3e41741638238a7ac3ebe4922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Creating volume 08429930-e98f-415f-945c-b93223159bc1 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:54:04 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc23903-085f-4aa6-b2d3-016c35853e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16da699-cf75-4a99-a6b1-0e10465fd010', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6347ee3-e18d-4f74-92a8-a743967b51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:04 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 1073741824 Jun 04 14:54:04 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:04 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Volume volume-a16da699-cf75-4a99-a6b1-0e10465fd010 (a16da699-cf75-4a99-a6b1-0e10465fd010): created successfully Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6347ee3-e18d-4f74-92a8-a743967b51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Flow 'volume_create_manager' (2ca4ae4b-8458-4d2b-be0d-729b136ba04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-17cbec59-3c30-46ba-b176-7ab29499210f tempest-GroupsV314Test-1876964752 None] Created volume successfully. Jun 04 14:54:05 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 1073741824" returned: 0 in 0.877s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:05 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 Jun 04 14:54:05 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:06 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1" returned: 0 in 0.752s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:06 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Cloning volume a16da699-cf75-4a99-a6b1-0e10465fd010 to volume feb76c65-cf45-4ddf-a51f-6cb440016059 Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7404e6-a512-4889-9c25-7f666a934d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08429930-e98f-415f-945c-b93223159bc1', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1b89e7-ec5d-4f25-bd3a-40732b1f1523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:06 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Volume volume-08429930-e98f-415f-945c-b93223159bc1 (08429930-e98f-415f-945c-b93223159bc1): created successfully Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1b89e7-ec5d-4f25-bd3a-40732b1f1523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Flow 'volume_create_manager' (aceb6e25-0e3b-4bde-8809-6336daf45080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Creating offline snapshot 4c20c7f3-3c77-446e-90ac-c0d3ed7a479a of volume a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:54:06 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6818f83b-f1e3-4467-bb67-dfaf9e55a3e7 tempest-TestMinimumBasicScenario-954744440 None] Created volume successfully. Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec81b72-5549-467e-8069-416a7aa511d4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:06 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:06 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:07 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.883s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:07 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a 1G Jun 04 14:54:07 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:08 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a 1G" returned: 0 in 0.897s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16da699-cf75-4a99-a6b1-0e10465fd010 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:08 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16da699-cf75-4a99-a6b1-0e10465fd010 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a Jun 04 14:54:08 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:08 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16da699-cf75-4a99-a6b1-0e10465fd010 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" returned: 0 in 0.671s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:08 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:54:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:08 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a Jun 04 14:54:08 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:09 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" returned: 0 in 0.638s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:09 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info Jun 04 14:54:09 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:10 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info" returned: 0 in 0.685s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:10 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:10 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info Jun 04 14:54:10 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Flow 'volume_create_manager' (8777e70e-1484-40da-b426-27223ddf86a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a90ed8-f028-4a96-a095-df65759e0973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a90ed8-f028-4a96-a095-df65759e0973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1771403040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0960a80b-1739-4e05-b5a2-34a9384d7b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3208154ae4bb429b800ca57a49bf68a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:11Z,use_quota=True,user_id='1fab8e11866f4e719ee0a143a4e7d055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8573b73d-ea5f-40fe-a70f-f410e87c1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8573b73d-ea5f-40fe-a70f-f410e87c1942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a9eca7-e1a9-4de1-b50c-75d4e804ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a9eca7-e1a9-4de1-b50c-75d4e804ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0960a80b-1739-4e05-b5a2-34a9384d7b8e', 'volume_name': 'volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaff00d-2659-4b9f-b86d-91b7315f7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaff00d-2659-4b9f-b86d-91b7315f7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c2e45-d425-4c35-9647-487994fdc593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Volume 0960a80b-1739-4e05-b5a2-34a9384d7b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e', 'volume_size': 1} Jun 04 14:54:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:11 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.info" returned: 0 in 0.974s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Acquiring lock "cinder-quobyte-feb76c65-cf45-4ddf-a51f-6cb440016059" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-feb76c65-cf45-4ddf-a51f-6cb440016059" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] snapshot: 4c20c7f3-3c77-446e-90ac-c0d3ed7a479a, volume: feb76c65-cf45-4ddf-a51f-6cb440016059, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afcb1d9-6323-4456-918c-d92dbb704fda]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:11 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a Jun 04 14:54:11 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:12 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" returned: 0 in 0.725s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a16da699-cf75-4a99-a6b1-0e10465fd010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[954f7f86-a62f-42ad-9446-a88355aee6e7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:12 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:12 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:12 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.701s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:54:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:12 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 Jun 04 14:54:12 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:17 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059" returned: 0 in 4.335s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa5480-11d3-4eac-bdb6-48843ce47fec]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:17 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:17 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:17 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.835s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:17 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:54:17 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Converted 1024.00 MB image at 236.12 MB/s Jun 04 14:54:17 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 14:54:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:18 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 Jun 04 14:54:18 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:18 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059" returned: 0 in 0.563s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-feb76c65-cf45-4ddf-a51f-6cb440016059" released by "_copy_volume_from_snapshot" :: held 7.250s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=81,cinder:UPDATE=57,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Acquiring lock "cinder-quobyte-4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Deleting offline snapshot 4c20c7f3-3c77-446e-90ac-c0d3ed7a479a of volume a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] snapshot_file for this snap is: volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1519de7-87a6-46b0-8469-715561c6ff36]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:18 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a Jun 04 14:54:18 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:19 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" returned: 0 in 0.677s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a16da699-cf75-4a99-a6b1-0e10465fd010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:54:19 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa38ea3-37b1-4272-86e2-7b8d7777ac89]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:19 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:19 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:20 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.761s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:20 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a Jun 04 14:54:20 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:20 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" returned: 0 in 0.667s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:20 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a Jun 04 14:54:20 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:20 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=61,cinder:UPDATE=79,cinder:INSERT=16,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:54:21 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010.4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" returned: 0 in 0.588s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-4c20c7f3-3c77-446e-90ac-c0d3ed7a479a" released by "_delete_snapshot" :: held 2.779s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:54:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.024s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.567s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:21 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3407e16-e522-40a6-b7b5-4a09816ce6e3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6a176993-9f09-408e-be19-b5877ad9bf2c tempest-GroupsV314Test-1876964752 None] Create group from source-group-b6aea8bf-8f3a-4ddf-8ec1-dfa91c61d3b7 completed successfully. Jun 04 14:54:21 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 Jun 04 14:54:21 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:22 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1" returned: 0 in 0.706s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.192s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1771403040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0960a80b-1739-4e05-b5a2-34a9384d7b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3208154ae4bb429b800ca57a49bf68a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:11Z,use_quota=True,user_id='1fab8e11866f4e719ee0a143a4e7d055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Creating volume 0960a80b-1739-4e05-b5a2-34a9384d7b8e {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:54:22 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:22 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e 1073741824 Jun 04 14:54:22 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-08429930-e98f-415f-945c-b93223159bc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '982ff9fd-5419-4937-adc9-9fe6799c72be', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:54:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-2c2fa813-47dc-4429-a144-f9745f9ecdc5 req-3010aba3-f3ae-4e8c-9b33-925df51e59a7 tempest-TestMinimumBasicScenario-954744440 None] attachment_update completed successfully. Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:22 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:54:22 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Acquiring lock "cinder-quobyte-feb76c65-cf45-4ddf-a51f-6cb440016059" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-feb76c65-cf45-4ddf-a51f-6cb440016059" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ed406-1348-41c5-9825-51baf01105d1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:22 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e 1073741824" returned: 0 in 0.889s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:23 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 Jun 04 14:54:23 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:23 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e Jun 04 14:54:23 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:23 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.712s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:54:23 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e" returned: 0 in 0.676s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.330s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:23 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059" returned: 0 in 0.806s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0008b8-d1b9-4cef-a4b3-b8d2de6dc59e]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:23 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059 Jun 04 14:54:23 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c2e45-d425-4c35-9647-487994fdc593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25833e6-1d25-41dd-85af-ffd05393dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:23 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Volume volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e (0960a80b-1739-4e05-b5a2-34a9384d7b8e): created successfully Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25833e6-1d25-41dd-85af-ffd05393dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Flow 'volume_create_manager' (8777e70e-1484-40da-b426-27223ddf86a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:23 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8204223b-faca-46ce-b404-6d446de5f270 tempest-AttachVolumeNegativeTest-1284004915 None] Created volume successfully. Jun 04 14:54:23 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:54:23 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:24 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-feb76c65-cf45-4ddf-a51f-6cb440016059" returned: 0 in 0.690s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-feb76c65-cf45-4ddf-a51f-6cb440016059" released by "delete_volume" :: held 1.542s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Created reservations ['38c9332e-1e9d-492e-bb76-a28a35e2b640'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:54:24 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 0.790s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:24 devstack cinder-volume[86522]: WARNING cinder.quota [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1551715795 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1551715795, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:54:24 devstack cinder-volume[86522]: WARNING cinder.quota [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1551715795 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1551715795, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '849abd67-03ce-44dd-8cca-941cadaa56ee', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Created reservations ['4bb00910-1eed-4ba1-a8aa-a1795ec5a372', '2dceb668-33dc-465e-9c5b-d4d63b2ea470', '066ee5df-0110-4984-ae1f-426053677a66', 'aba06d69-e333-41b2-b9ed-53284750e142'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:54:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-814abe3c-808e-45f0-bb48-1a048d987ac4 req-532ce837-7bb1-405c-b132-6df7629f14f4 tempest-TestStampPattern-24935867 None] attachment_update completed successfully. Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:24 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:54:24 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Acquiring lock "cinder-quobyte-a16da699-cf75-4a99-a6b1-0e10465fd010" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-a16da699-cf75-4a99-a6b1-0e10465fd010" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:25 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[87364b1e-1084-461d-a189-0bfccc655304]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:25 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.671s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:25 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:54:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-10f87097-adee-4b0a-b76b-ed95485040ca tempest-GroupsV314Test-1876964752 None] Delete group completed successfully. Jun 04 14:54:25 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:25 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:26 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:26 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010 Jun 04 14:54:26 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:26 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a16da699-cf75-4a99-a6b1-0e10465fd010" returned: 0 in 0.611s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Lock "cinder-quobyte-a16da699-cf75-4a99-a6b1-0e10465fd010" released by "delete_volume" :: held 1.427s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Created reservations ['162d567c-cd83-4a05-add2-769c51a35a2c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Created reservations ['d48a00ba-98d1-4f6f-9ccf-39caf7f588b9', '84c2c0f6-af6b-473a-887e-7b9ea833308a', 'c4112c2d-e264-4281-8b53-6a71afe462f0', '76d902f5-45ed-4633-895f-543c50c4530b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:27 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:54:27 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:27 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.665s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:27 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:54:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-cebbad87-da1b-49a6-bcf2-a871fed22954 tempest-GroupsV314Test-1876964752 None] Delete group completed successfully. Jun 04 14:54:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:27 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b96686-dee9-4fb2-9098-0afd2efd6bd2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:27 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e Jun 04 14:54:27 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:28 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e" returned: 0 in 0.815s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c99bfaf-ffb9-412a-a523-695abecfd2b2', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:54:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-78a7ed83-6710-49d1-a70f-6c55461a136e req-bac611e6-f5f7-4c41-bc82-ae109ad43f0b tempest-AttachVolumeNegativeTest-1284004915 None] attachment_update completed successfully. Jun 04 14:54:34 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-33eb6190-8be9-4381-8720-0b782906178f req-ff137de0-bedc-48fc-8d2f-3f80583d5258 tempest-TestStampPattern-24935867 None] Terminate volume connection completed successfully. Jun 04 14:54:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-33eb6190-8be9-4381-8720-0b782906178f req-ff137de0-bedc-48fc-8d2f-3f80583d5258 tempest-TestStampPattern-24935867 None] Deleting attachment 849abd67-03ce-44dd-8cca-941cadaa56ee. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:54:34 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-3b0ede88-e5e0-4cd3-8c29-2fbf873a89bb req-8177b6cf-404e-47f9-996e-21bf176af0fe tempest-AttachVolumeNegativeTest-1284004915 None] Terminate volume connection completed successfully. Jun 04 14:54:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-3b0ede88-e5e0-4cd3-8c29-2fbf873a89bb req-8177b6cf-404e-47f9-996e-21bf176af0fe tempest-AttachVolumeNegativeTest-1284004915 None] Deleting attachment 4c99bfaf-ffb9-412a-a523-695abecfd2b2. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:54:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Creating offline snapshot 5e338102-6d59-49d9-80b7-e5e20ca7c3c3 of volume 9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:54:36 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b83b7c-fd2c-4620-8903-a5cbd669ae98]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:36 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:54:36 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:37 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 0.848s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:37 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 1G Jun 04 14:54:37 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:38 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 1G" returned: 0 in 1.033s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:38 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 Jun 04 14:54:38 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:39 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3" returned: 0 in 0.952s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:39 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 is being set with open permissions: ugo+rw Jun 04 14:54:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:39 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 Jun 04 14:54:39 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:39 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3" returned: 0 in 0.722s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:40 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info Jun 04 14:54:40 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:40 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:40 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info is being set with open permissions: ugo+rw Jun 04 14:54:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:40 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info Jun 04 14:54:40 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:41 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.info" returned: 0 in 0.702s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ac1f240f-2084-4719-a342-ba3ba3c95cee tempest-TestStampPattern-24935867 None] Create snapshot completed successfully Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Flow 'volume_create_manager' (64d8c88c-4574-4ff8-b544-132d13bffdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eaf821-aa1a-46af-b659-c197b7a6eb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eaf821-aa1a-46af-b659-c197b7a6eb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1404947972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8bd3a96-a672-427f-9457-320a75bada33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a044d04dd6294977bf69723a4078f13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:50Z,use_quota=True,user_id='279d3e73b4fd4f7186ea759320ba2207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d97042-2d46-46b0-b116-1e14ec097ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d97042-2d46-46b0-b116-1e14ec097ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb2e2b6-1787-4e48-8eb8-01bba8637156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb2e2b6-1787-4e48-8eb8-01bba8637156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8bd3a96-a672-427f-9457-320a75bada33', 'volume_name': 'volume-e8bd3a96-a672-427f-9457-320a75bada33', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa53342-9edd-4e7a-b121-861e54407249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa53342-9edd-4e7a-b121-861e54407249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766cd1bc-2c72-494b-98d8-d711e14b1297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Volume e8bd3a96-a672-427f-9457-320a75bada33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8bd3a96-a672-427f-9457-320a75bada33', 'volume_size': 1} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1404947972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8bd3a96-a672-427f-9457-320a75bada33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a044d04dd6294977bf69723a4078f13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:50Z,use_quota=True,user_id='279d3e73b4fd4f7186ea759320ba2207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Creating volume e8bd3a96-a672-427f-9457-320a75bada33 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:54:50 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:54:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:50 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 1073741824 Jun 04 14:54:50 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:51 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 1073741824" returned: 0 in 1.215s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:51 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 Jun 04 14:54:51 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:52 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33" returned: 0 in 0.801s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766cd1bc-2c72-494b-98d8-d711e14b1297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8bd3a96-a672-427f-9457-320a75bada33', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ee127b-82d0-474b-a8e5-476cf068cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Volume volume-e8bd3a96-a672-427f-9457-320a75bada33 (e8bd3a96-a672-427f-9457-320a75bada33): created successfully Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ee127b-82d0-474b-a8e5-476cf068cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Flow 'volume_create_manager' (64d8c88c-4574-4ff8-b544-132d13bffdde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:52 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2dc200ea-2ae8-438f-8ac8-282ed730d7bf tempest-VolumeQuotasNegativeTestJSON-457268789 None] Created volume successfully. Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Flow 'volume_create_manager' (a0b6a444-0d95-4eeb-9cc8-1ebd4bec071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a881358-ac66-4f55-9a15-85dc6ea46ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a881358-ac66-4f55-9a15-85dc6ea46ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1225456192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e285a087-45ee-49ee-be43-81e197f59c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae103c30e1704d8198504b24f79e6ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e338102-6d59-49d9-80b7-e5e20ca7c3c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:54:54Z,use_quota=True,user_id='31ab80c105f24d589c11f52351930240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2025be-750f-4b7d-9685-e52057151221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2025be-750f-4b7d-9685-e52057151221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9207c927-9d12-41ce-a7bb-66113658dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9207c927-9d12-41ce-a7bb-66113658dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e285a087-45ee-49ee-be43-81e197f59c78', 'volume_name': 'volume-e285a087-45ee-49ee-be43-81e197f59c78', 'volume_size': 1, 'snapshot_id': '5e338102-6d59-49d9-80b7-e5e20ca7c3c3'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8651443-5fde-4f79-9d21-3683d20463c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8651443-5fde-4f79-9d21-3683d20463c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db502aa-bbe3-4a16-b9ff-2fbab1096258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:54:53 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Volume e285a087-45ee-49ee-be43-81e197f59c78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e285a087-45ee-49ee-be43-81e197f59c78', 'volume_size': 1, 'snapshot_id': '5e338102-6d59-49d9-80b7-e5e20ca7c3c3'} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-quobyte-5e338102-6d59-49d9-80b7-e5e20ca7c3c3-e285a087-45ee-49ee-be43-81e197f59c78" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-5e338102-6d59-49d9-80b7-e5e20ca7c3c3-e285a087-45ee-49ee-be43-81e197f59c78" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Creating volume e285a087-45ee-49ee-be43-81e197f59c78 from snapshot 5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-quobyte-e285a087-45ee-49ee-be43-81e197f59c78" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-e285a087-45ee-49ee-be43-81e197f59c78" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] snapshot: 5e338102-6d59-49d9-80b7-e5e20ca7c3c3, volume: e285a087-45ee-49ee-be43-81e197f59c78, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[34280a84-23f5-4a73-90e3-295f70129e8a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:54 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 Jun 04 14:54:54 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:54 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3" returned: 0 in 0.895s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c35a8ef-fdda-4579-8a97-f755ff535992]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:55 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:54:55 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Acquiring lock "cinder-e8bd3a96-a672-427f-9457-320a75bada33-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "cinder-e8bd3a96-a672-427f-9457-320a75bada33-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Acquiring lock "cinder-quobyte-e8bd3a96-a672-427f-9457-320a75bada33" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "cinder-quobyte-e8bd3a96-a672-427f-9457-320a75bada33" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced4975-868e-4cb0-89b0-9bc4fbafccd2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:55 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 Jun 04 14:54:55 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:55 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 1.008s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 14:54:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:56 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 Jun 04 14:54:56 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:56 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33" returned: 0 in 1.302s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:56 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33 Jun 04 14:54:56 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:54:57 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jun 04 14:54:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e8bd3a96-a672-427f-9457-320a75bada33" returned: 0 in 1.009s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:54:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "cinder-quobyte-e8bd3a96-a672-427f-9457-320a75bada33" released by "delete_volume" :: held 2.411s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Created reservations ['0024302a-b6c3-4a2c-a651-058d18dbe51a', 'c32799ee-7729-461c-b336-3da71377af3e', '9ab69249-6e30-4bb2-b74b-b3b7b8f63d5b', 'a18342f8-06b7-4968-9a1a-2aeeb87fa9e7'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:54:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:54:58 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:54:58 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:00 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 2.459s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:00 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:55:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Deleted volume successfully. Jun 04 14:55:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99434c96-ef45-41c4-8c31-842d108a2973 tempest-VolumeQuotasNegativeTestJSON-457268789 None] Lock "cinder-e8bd3a96-a672-427f-9457-320a75bada33-delete_volume" released by "delete_volume" :: held 5.413s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:04 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78" returned: 0 in 8.959s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:04 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0854cb-4109-49ac-941a-62f67fce5b90]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:55:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:05 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:55:05 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:06 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 1.267s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:06 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d, size 1024.00 MB, duration 8.96 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:55:06 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Converted 1024.00 MB image at 114.29 MB/s Jun 04 14:55:06 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 is being set with open permissions: ugo+rw Jun 04 14:55:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:06 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 Jun 04 14:55:06 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:07 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78" returned: 0 in 0.819s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-e285a087-45ee-49ee-be43-81e197f59c78" released by "_copy_volume_from_snapshot" :: held 13.116s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-5e338102-6d59-49d9-80b7-e5e20ca7c3c3-e285a087-45ee-49ee-be43-81e197f59c78" released by "_create_volume_from_snapshot" :: held 13.160s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.184s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db502aa-bbe3-4a16-b9ff-2fbab1096258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e285a087-45ee-49ee-be43-81e197f59c78', 'volume_size': 1, 'snapshot_id': '5e338102-6d59-49d9-80b7-e5e20ca7c3c3'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4bd580-a3c9-4f8e-b8ae-9a5714604ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:07 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Volume volume-e285a087-45ee-49ee-be43-81e197f59c78 (e285a087-45ee-49ee-be43-81e197f59c78): created successfully Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4bd580-a3c9-4f8e-b8ae-9a5714604ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Flow 'volume_create_manager' (a0b6a444-0d95-4eeb-9cc8-1ebd4bec071b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:55:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6475b342-4cac-46e1-ba2c-6b3cdcfc95a8 tempest-TestStampPattern-24935867 None] Created volume successfully. Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Flow 'volume_create_manager' (b1dd0903-4221-4dd0-8d47-c84389ddfd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8262cf03-6745-4616-a6f7-ce51048e0218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8262cf03-6745-4616-a6f7-ce51048e0218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1662031125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d5f44f-a4ef-4319-aecb-281789b50304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c98430c003472589c9460aa388d6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:55:13Z,use_quota=True,user_id='08eb62049b144b92ac459996e5f95ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69427b3c-c4f3-4d4b-970d-d1ed2c399a9c),volume_type_id=69427b3c-c4f3-4d4b-970d-d1ed2c399a9c)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e68edad-ca2e-49e9-bd3e-e267b4e7f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e68edad-ca2e-49e9-bd3e-e267b4e7f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f736ebc-5e55-4cbf-b11e-b5754dca3e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f736ebc-5e55-4cbf-b11e-b5754dca3e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d5f44f-a4ef-4319-aecb-281789b50304', 'volume_name': 'volume-f5d5f44f-a4ef-4319-aecb-281789b50304', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53befe1-b066-46f1-837c-e0b913c952ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53befe1-b066-46f1-837c-e0b913c952ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2284afd-e923-4a92-9ded-4cbe803c062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:13 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Volume f5d5f44f-a4ef-4319-aecb-281789b50304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d5f44f-a4ef-4319-aecb-281789b50304', 'volume_size': 1} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1662031125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d5f44f-a4ef-4319-aecb-281789b50304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c98430c003472589c9460aa388d6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:55:13Z,use_quota=True,user_id='08eb62049b144b92ac459996e5f95ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69427b3c-c4f3-4d4b-970d-d1ed2c399a9c),volume_type_id=69427b3c-c4f3-4d4b-970d-d1ed2c399a9c)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Creating volume f5d5f44f-a4ef-4319-aecb-281789b50304 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:55:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:55:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:13 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 1073741824 Jun 04 14:55:13 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:16 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 1073741824" returned: 0 in 2.765s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:16 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 Jun 04 14:55:16 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:17 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304" returned: 0 in 1.662s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] <== create_volume: return (4582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:55:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.587s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2284afd-e923-4a92-9ded-4cbe803c062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d5f44f-a4ef-4319-aecb-281789b50304', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fde2d10-b6b9-48ad-bed4-c3ff21824986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Volume volume-f5d5f44f-a4ef-4319-aecb-281789b50304 (f5d5f44f-a4ef-4319-aecb-281789b50304): created successfully Jun 04 14:55:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fde2d10-b6b9-48ad-bed4-c3ff21824986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Flow 'volume_create_manager' (b1dd0903-4221-4dd0-8d47-c84389ddfd3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:55:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0a94faf0-696b-487d-a6ed-5fadbb239cfe tempest-VolumeTypesAccessTest-1498142580 None] Created volume successfully. Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Acquiring lock "cinder-f5d5f44f-a4ef-4319-aecb-281789b50304-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Lock "cinder-f5d5f44f-a4ef-4319-aecb-281789b50304-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=44,cinder:SELECT=55,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Acquiring lock "cinder-quobyte-f5d5f44f-a4ef-4319-aecb-281789b50304" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Lock "cinder-quobyte-f5d5f44f-a4ef-4319-aecb-281789b50304" acquired by "delete_volume" :: waited 0.050s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6624161-c9a9-47b9-94e2-d65efd92acd4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:55:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:19 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 Jun 04 14:55:19 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:20 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-90a76fdd-1b70-4353-b922-f38684fdaff3 req-d39b37f0-00b4-4174-8882-63d6e871045c tempest-TestMinimumBasicScenario-954744440 None] Terminate volume connection completed successfully. Jun 04 14:55:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-90a76fdd-1b70-4353-b922-f38684fdaff3 req-d39b37f0-00b4-4174-8882-63d6e871045c tempest-TestMinimumBasicScenario-954744440 None] Deleting attachment 982ff9fd-5419-4937-adc9-9fe6799c72be. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:55:21 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304" returned: 0 in 1.935s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:21 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304 Jun 04 14:55:21 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Acquiring lock "cinder-08429930-e98f-415f-945c-b93223159bc1-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Lock "cinder-08429930-e98f-415f-945c-b93223159bc1-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:55:22 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:22 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:55:22 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f5d5f44f-a4ef-4319-aecb-281789b50304" returned: 0 in 1.007s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Lock "cinder-quobyte-f5d5f44f-a4ef-4319-aecb-281789b50304" released by "delete_volume" :: held 3.084s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=54,cinder:SELECT=54,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Acquiring lock "cinder-quobyte-08429930-e98f-415f-945c-b93223159bc1" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:55:22 devstack cinder-volume[86522]: WARNING cinder.quota [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-691653727 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-691653727, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:55:22 devstack cinder-volume[86522]: WARNING cinder.quota [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-691653727 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-691653727, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Lock "cinder-quobyte-08429930-e98f-415f-945c-b93223159bc1" acquired by "delete_volume" :: waited 0.058s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8812e6-2dcc-4d18-9839-fd7be23e0149]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Created reservations ['3b5950e2-8a14-43e1-a879-0c8744066eab', '1a21d6e2-f7ab-4e9c-8644-43c039762d67', 'bd25ad72-2ec7-4814-8e25-a20dd27d81f5', '5d529b67-e6d9-4e2f-9ef6-b12cedc32e11'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:22 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:55:22 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:23 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 Jun 04 14:55:23 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:24 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1" returned: 0 in 1.340s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:24 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1 Jun 04 14:55:24 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:24 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.932s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:55:24 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.815s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:55:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Deleted volume successfully. Jun 04 14:55:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a70eb47c-e71e-4b60-9543-9fc14f633e55 tempest-VolumeTypesAccessTest-1498142580 None] Lock "cinder-f5d5f44f-a4ef-4319-aecb-281789b50304-delete_volume" released by "delete_volume" :: held 5.543s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:25 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-08429930-e98f-415f-945c-b93223159bc1" returned: 0 in 1.305s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Lock "cinder-quobyte-08429930-e98f-415f-945c-b93223159bc1" released by "delete_volume" :: held 2.751s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Created reservations ['a45a0580-8b97-4cea-b44e-2af2f4d171b5', 'd2dbe13e-5b4c-4cc9-bcbe-9f2f511fb91c', 'f3fc5c11-f10b-4d4f-959d-559d9f0e31f1', 'ea84b4c8-35dd-4307-bb00-856093faef9a'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:25 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:55:25 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:26 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.821s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:26 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:55:26 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Deleted volume successfully. Jun 04 14:55:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d2e4f025-de0a-486b-ab07-8033c24c814e tempest-TestMinimumBasicScenario-954744440 None] Lock "cinder-08429930-e98f-415f-945c-b93223159bc1-delete_volume" released by "delete_volume" :: held 4.017s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:55:35 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:55:36 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:55:39 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:55:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Flow 'volume_create_manager' (7517fbb3-7591-43f8-b28a-882542809274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:55:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cf8835-e607-47b6-94a3-212ace7bb0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cf8835-e607-47b6-94a3-212ace7bb0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1295302990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c61a2d-372a-44f6-8f22-cca3dfe05f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3208154ae4bb429b800ca57a49bf68a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:55:40Z,use_quota=True,user_id='1fab8e11866f4e719ee0a143a4e7d055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f353707-a870-442d-9650-a922c4dc622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f353707-a870-442d-9650-a922c4dc622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c18639-f00f-4378-93d8-084b155f6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c18639-f00f-4378-93d8-084b155f6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c61a2d-372a-44f6-8f22-cca3dfe05f60', 'volume_name': 'volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d673df9d-16d5-4267-bd24-bafa1c4580d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d673df9d-16d5-4267-bd24-bafa1c4580d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b261c80-34fc-43ef-b405-16f7fccb6b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:40 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Volume 53c61a2d-372a-44f6-8f22-cca3dfe05f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60', 'volume_size': 1} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1295302990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c61a2d-372a-44f6-8f22-cca3dfe05f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3208154ae4bb429b800ca57a49bf68a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:55:40Z,use_quota=True,user_id='1fab8e11866f4e719ee0a143a4e7d055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Creating volume 53c61a2d-372a-44f6-8f22-cca3dfe05f60 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:55:40 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:55:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:40 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 1073741824 Jun 04 14:55:40 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:41 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 1073741824" returned: 0 in 1.059s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:41 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 Jun 04 14:55:41 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:41 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b261c80-34fc-43ef-b405-16f7fccb6b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3f7ed8-24fd-492d-a2c9-b08274f9c01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:55:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Volume volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 (53c61a2d-372a-44f6-8f22-cca3dfe05f60): created successfully Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3f7ed8-24fd-492d-a2c9-b08274f9c01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:55:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Flow 'volume_create_manager' (7517fbb3-7591-43f8-b28a-882542809274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:55:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4989d12b-6fbc-4566-89f8-6a286d8cf7dc tempest-AttachVolumeNegativeTest-1284004915 None] Created volume successfully. Jun 04 14:55:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe4161a-ff0f-4899-a95a-0f80a01577ce]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:55:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:45 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 Jun 04 14:55:45 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:46 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60" returned: 0 in 0.893s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.918s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ed68211-ce72-430e-920e-10b82c6eafac', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:55:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-dac2b266-3128-4002-b18f-525237debed4 req-9fb27958-d3ce-4b2d-b6b5-ec4f1d674689 tempest-AttachVolumeNegativeTest-1284004915 None] attachment_update completed successfully. Jun 04 14:55:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:55:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:55:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cdce41-628e-41f6-8778-fa130738c0d7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:55:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:55:48 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 Jun 04 14:55:48 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:55:49 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jun 04 14:55:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78" returned: 0 in 0.986s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:55:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.019s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:55:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-e285a087-45ee-49ee-be43-81e197f59c78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f1f54ac-c221-4c7a-a44f-5ef2e57a5731', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:55:49 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-6898f396-e5b2-4f58-bca5-6df7935abe02 req-1549aec6-adcb-4972-ab04-5e084f496850 tempest-TestStampPattern-24935867 None] attachment_update completed successfully. Jun 04 14:55:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-0d88d2a3-d738-47f6-b1e5-0e7aabb40524 req-c9c6560a-a1a1-4cc5-af62-385d4ad7624c tempest-AttachVolumeNegativeTest-1284004915 None] Terminate volume connection completed successfully. Jun 04 14:55:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-0d88d2a3-d738-47f6-b1e5-0e7aabb40524 req-c9c6560a-a1a1-4cc5-af62-385d4ad7624c tempest-AttachVolumeNegativeTest-1284004915 None] Deleting attachment 7ed68211-ce72-430e-920e-10b82c6eafac. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:55:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-210bff69-1457-4669-8e93-c0f415f09ea5 req-e4253d4b-6bb6-4c12-9ca5-8787ca7e3eb6 tempest-TestStampPattern-24935867 None] Terminate volume connection completed successfully. Jun 04 14:55:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-210bff69-1457-4669-8e93-c0f415f09ea5 req-e4253d4b-6bb6-4c12-9ca5-8787ca7e3eb6 tempest-TestStampPattern-24935867 None] Deleting attachment 0f1f54ac-c221-4c7a-a44f-5ef2e57a5731. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=5,cinder:SELECT=17,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "cinder-53c61a2d-372a-44f6-8f22-cca3dfe05f60-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-53c61a2d-372a-44f6-8f22-cca3dfe05f60-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "cinder-quobyte-53c61a2d-372a-44f6-8f22-cca3dfe05f60" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-quobyte-53c61a2d-372a-44f6-8f22-cca3dfe05f60" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3979bd-05f3-45e1-8b93-b46bfe8ab6f6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:08 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 Jun 04 14:56:08 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-e285a087-45ee-49ee-be43-81e197f59c78-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Lock "cinder-e285a087-45ee-49ee-be43-81e197f59c78-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-quobyte-e285a087-45ee-49ee-be43-81e197f59c78" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-e285a087-45ee-49ee-be43-81e197f59c78" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[584b0f77-f16d-4cca-b0b6-69650c2f2ee3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:08 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 Jun 04 14:56:08 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:08 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60" returned: 0 in 0.878s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:08 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60 Jun 04 14:56:08 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:09 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-53c61a2d-372a-44f6-8f22-cca3dfe05f60" returned: 0 in 0.619s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-quobyte-53c61a2d-372a-44f6-8f22-cca3dfe05f60" released by "delete_volume" :: held 1.554s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:09 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:09 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78 Jun 04 14:56:09 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Created reservations ['24677ac1-d2ba-4dc6-8e95-926765749a3e', '18473289-5a0c-4cd9-b0f5-db5beca831df', 'e8333867-8f80-432a-8c42-5159b1265b52', '42c416b6-4e11-43c0-9034-ce94d66a6118'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:09 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:09 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "cinder-0960a80b-1739-4e05-b5a2-34a9384d7b8e-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-0960a80b-1739-4e05-b5a2-34a9384d7b8e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "cinder-quobyte-0960a80b-1739-4e05-b5a2-34a9384d7b8e" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:10 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e285a087-45ee-49ee-be43-81e197f59c78" returned: 0 in 0.914s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-quobyte-0960a80b-1739-4e05-b5a2-34a9384d7b8e" acquired by "delete_volume" :: waited 0.041s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-e285a087-45ee-49ee-be43-81e197f59c78" released by "delete_volume" :: held 1.839s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93c9951-29fb-45b9-9e0c-0bc525fa927f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Created reservations ['62cb659f-02b3-40ef-8d7b-9ca725d7c532', '03396e83-675f-4163-9a4a-a860d8d539ae', '7f1ea614-2540-4b5e-ae0f-9bcc10adef9b', 'fba0c932-0adb-4b57-8573-63b73e27f6f6'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:10 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e Jun 04 14:56:10 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:10 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:10 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:10 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.067s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Deleted volume successfully. Jun 04 14:56:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-541b49c9-fa7b-4138-a53d-ff1f26845acb tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-53c61a2d-372a-44f6-8f22-cca3dfe05f60-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-5e338102-6d59-49d9-80b7-e5e20ca7c3c3-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Lock "cinder-5e338102-6d59-49d9-80b7-e5e20ca7c3c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-quobyte-9f87d3fb-33c9-4ff1-9020-5782db5e777d" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-9f87d3fb-33c9-4ff1-9020-5782db5e777d" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-quobyte-5e338102-6d59-49d9-80b7-e5e20ca7c3c3" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-5e338102-6d59-49d9-80b7-e5e20ca7c3c3" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Deleting offline snapshot 5e338102-6d59-49d9-80b7-e5e20ca7c3c3 of volume 9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] snapshot_file for this snap is: volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e265c-a68b-4144-aa92-748421866b38]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:11 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 Jun 04 14:56:11 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:11 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.052s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Deleted volume successfully. Jun 04 14:56:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4ea2b53b-3a5e-44c3-807e-fa0c3c03e9f7 tempest-TestStampPattern-24935867 None] Lock "cinder-e285a087-45ee-49ee-be43-81e197f59c78-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:12 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e" returned: 0 in 1.551s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:12 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e Jun 04 14:56:12 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:13 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3" returned: 0 in 1.542s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d888b73-7f9a-4bfb-8d82-86503d97b049]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:13 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0960a80b-1739-4e05-b5a2-34a9384d7b8e" returned: 0 in 1.177s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:13 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:56:13 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-quobyte-0960a80b-1739-4e05-b5a2-34a9384d7b8e" released by "delete_volume" :: held 2.802s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Created reservations ['748f9d09-9476-40f8-8e15-f7d3e69ddedf', '9c52a271-4289-47b3-ae60-1dd01fab23ca', '1920e410-6497-4d33-b5fc-181187c28ba7', 'e71910a5-2304-4942-a5de-18591792fb7c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:13 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:13 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:14 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 1.309s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "cinder-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:14 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 Jun 04 14:56:14 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "cinder-quobyte-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-quobyte-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" acquired by "delete_volume" :: waited 0.052s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd11b2f-3065-4ac2-b92c-dd68c2681501]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:14 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc Jun 04 14:56:14 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:14 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.508s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:15 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Deleted volume successfully. Jun 04 14:56:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c627bd79-9840-4930-a48d-cbb0ca877640 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-0960a80b-1739-4e05-b5a2-34a9384d7b8e-delete_volume" released by "delete_volume" :: held 4.790s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:15 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" returned: 0 in 1.261s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:16 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3" returned: 0 in 1.610s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:16 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc Jun 04 14:56:16 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:16 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3 Jun 04 14:56:16 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (1c15ea9c-8807-443c-8bb6-89017dbfea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58a6269-9996-4c94-8f32-bc81cd8eae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58a6269-9996-4c94-8f32-bc81cd8eae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2144673146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:16Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed2b691-1200-4e3b-bc2d-d35e458e8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed2b691-1200-4e3b-bc2d-d35e458e8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8dc4f9-c033-41c5-86a5-5ccde4e5aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8dc4f9-c033-41c5-86a5-5ccde4e5aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e', 'volume_name': 'volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90ae188-26b2-4929-8064-087148b97e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90ae188-26b2-4929-8064-087148b97e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202b64dc-cdbf-4b53-a97e-d40f0948a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:16 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Volume 89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e', 'volume_size': 1} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2144673146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:16Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Creating volume 89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:16 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:16 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e 1073741824 Jun 04 14:56:16 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:16 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d.5e338102-6d59-49d9-80b7-e5e20ca7c3c3" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-5e338102-6d59-49d9-80b7-e5e20ca7c3c3" released by "_delete_snapshot" :: held 5.518s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-9f87d3fb-33c9-4ff1-9020-5782db5e777d" released by "delete_snapshot" :: held 5.580s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Created reservations ['607b3790-aadb-4f80-9775-b43412d8d2e1', '881d9954-3012-45a0-95e2-fbc42efef596', 'debd0fb0-1af4-471b-8f7f-4dc095826240', 'aa519a7e-8f09-499f-a306-70ec89c0ec25'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:17 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" returned: 0 in 1.077s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-quobyte-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc" released by "delete_volume" :: held 2.456s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Delete snapshot completed successfully. Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a56a401d-bc5e-4860-9b45-95d52c45b65c tempest-TestStampPattern-24935867 None] Lock "cinder-5e338102-6d59-49d9-80b7-e5e20ca7c3c3-delete_snapshot" released by "delete_snapshot" :: held 5.897s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Created reservations ['906eeef8-35b6-4b7f-9279-96f77781c0de', 'de27414b-bdbc-4658-883b-eec90fe8bc3a', 'b8d1f300-a5e0-4681-b394-cdbcf8c9db45', '7a1fe962-96ad-4f4c-9c28-571e4a109f27'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:17 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:17 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:17 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e 1073741824" returned: 0 in 1.189s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:18 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e Jun 04 14:56:18 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:18 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.802s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Deleted volume successfully. Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-dc17bdc1-c055-43c0-9094-e4a7ad07a535 tempest-AttachVolumeNegativeTest-1284004915 None] Lock "cinder-ab1f6e43-4d6d-4ea7-ae5f-b61ec6223dfc-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:18 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" returned: 0 in 0.865s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202b64dc-cdbf-4b53-a97e-d40f0948a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ac1b45-7b27-4f66-b13d-46202f904387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:18 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Volume volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e (89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e): created successfully Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ac1b45-7b27-4f66-b13d-46202f904387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (1c15ea9c-8807-443c-8bb6-89017dbfea17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:18 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6e466793-9396-489d-9ee0-d23070ed1b02 tempest-VolumesActionsTest-1420519143 None] Created volume successfully. Jun 04 14:56:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-007cc7a5-5725-4c48-9395-8473bf49bbd6 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" by "attach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-007cc7a5-5725-4c48-9395-8473bf49bbd6 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" acquired by "attach_volume" :: waited 0.041s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-007cc7a5-5725-4c48-9395-8473bf49bbd6 tempest-VolumesActionsTest-1420519143 None] Attaching volume 89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e to instance 31d8fcea-6fb5-4d28-b7e6-733155e588a1 at mountpoint /dev/vdb on host None. Jun 04 14:56:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-007cc7a5-5725-4c48-9395-8473bf49bbd6 tempest-VolumesActionsTest-1420519143 None] Attach volume completed successfully. Jun 04 14:56:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-007cc7a5-5725-4c48-9395-8473bf49bbd6 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" released by "attach_volume" :: held 0.179s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-68771917-2a03-4fba-9cc6-641305dd2fda tempest-VolumesActionsTest-1354247408 None] Terminate volume connection completed successfully. Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-68771917-2a03-4fba-9cc6-641305dd2fda tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-detach_volume" by "detach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-68771917-2a03-4fba-9cc6-641305dd2fda tempest-VolumesActionsTest-1354247408 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-68771917-2a03-4fba-9cc6-641305dd2fda tempest-VolumesActionsTest-1354247408 None] Detaching volume 89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e from instance 31d8fcea-6fb5-4d28-b7e6-733155e588a1. Jun 04 14:56:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-68771917-2a03-4fba-9cc6-641305dd2fda tempest-VolumesActionsTest-1354247408 None] Detach volume completed successfully. Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-68771917-2a03-4fba-9cc6-641305dd2fda tempest-VolumesActionsTest-1354247408 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-detach_volume" released by "detach_volume" :: held 0.137s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:22 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:22 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4037ec89-fffe-48b5-b5d6-5ef0be0d0c58 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-detach_volume" by "detach_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4037ec89-fffe-48b5-b5d6-5ef0be0d0c58 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4037ec89-fffe-48b5-b5d6-5ef0be0d0c58 tempest-VolumesActionsTest-1420519143 None] Volume detach called, but volume not attached. Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4037ec89-fffe-48b5-b5d6-5ef0be0d0c58 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Acquiring lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:23 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.511s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Acquiring lock "cinder-quobyte-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Lock "cinder-quobyte-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" acquired by "delete_volume" :: waited 0.034s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:24 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce118c6-5746-436c-afa6-780d8b1a5743]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:24 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e Jun 04 14:56:24 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:25 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" returned: 0 in 1.375s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:25 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e Jun 04 14:56:25 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:26 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" returned: 0 in 0.753s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Lock "cinder-quobyte-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e" released by "delete_volume" :: held 2.200s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Created reservations ['b084fb5a-308d-42a6-883a-926a463aac1b', '0c0fbe6d-016e-43f6-a40a-905e33ba4bfb', '4948958c-3ab8-421c-9fdd-780ce5292bb4', '7d277bfd-ab4f-4244-a6c1-84fe06fe0653'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:26 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:26 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:27 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Deleted volume successfully. Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d3e42b66-8e3c-49f8-8446-f2b9b4920f3f tempest-VolumesActionsTest-1420519143 None] Lock "cinder-89ddb4a3-95a5-4e37-ae4c-c0a4dc61c99e-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-9f87d3fb-33c9-4ff1-9020-5782db5e777d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Lock "cinder-9f87d3fb-33c9-4ff1-9020-5782db5e777d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Acquiring lock "cinder-quobyte-9f87d3fb-33c9-4ff1-9020-5782db5e777d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-9f87d3fb-33c9-4ff1-9020-5782db5e777d" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a37d52-d3df-4e62-9c29-cdd6ecf22ae6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:27 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:56:27 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:28 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 1.079s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:28 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d Jun 04 14:56:28 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:29 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f87d3fb-33c9-4ff1-9020-5782db5e777d" returned: 0 in 0.713s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Lock "cinder-quobyte-9f87d3fb-33c9-4ff1-9020-5782db5e777d" released by "delete_volume" :: held 1.913s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Created reservations ['3505e549-fb1a-4f05-ae14-aa38b469eb19', 'c3935518-7326-4b63-ae37-86f8fd6285e3', 'e0a76906-c2a3-410e-b118-a2318c5e5af3', '8731e940-99e7-41ef-add4-6e69755edeb6'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:29 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:29 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:30 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.971s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:30 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:30 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Deleted volume successfully. Jun 04 14:56:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6cc83a63-1dbc-4b64-a002-4663f2dbf920 tempest-TestStampPattern-24935867 None] Lock "cinder-9f87d3fb-33c9-4ff1-9020-5782db5e777d-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (d9cbbe77-6a7c-4cf5-ab6b-f2873866a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937623ba-6594-4e46-96d9-05c947143b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937623ba-6594-4e46-96d9-05c947143b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096992436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:36Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f9bfe4-7056-4b57-b549-4f0ba97bfc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f9bfe4-7056-4b57-b549-4f0ba97bfc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe686dc-ff37-4242-993e-a24b9e9a319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe686dc-ff37-4242-993e-a24b9e9a319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da', 'volume_name': 'volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9847b428-ef31-4536-8136-c4d726e496c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9847b428-ef31-4536-8136-c4d726e496c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f3f4c2-7f25-46fa-9bf8-c3e43d67a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:35 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Volume a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da', 'volume_size': 1} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096992436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:36Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Creating volume a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:35 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:35 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da 1073741824 Jun 04 14:56:35 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:36 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da 1073741824" returned: 0 in 0.926s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:36 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da Jun 04 14:56:36 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:37 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f3f4c2-7f25-46fa-9bf8-c3e43d67a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1aa7f3a-812f-400a-a953-5dc3e5307f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:37 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Volume volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da (a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da): created successfully Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1aa7f3a-812f-400a-a953-5dc3e5307f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (d9cbbe77-6a7c-4cf5-ab6b-f2873866a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:37 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9136156a-5430-48cd-8b64-e4f2a13189ab tempest-VolumesActionsTest-1420519143 None] Created volume successfully. Jun 04 14:56:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Lock "cinder-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-quobyte-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:38 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457333e-8109-4fa7-adef-47ee85752fad]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:38 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da Jun 04 14:56:38 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:39 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da" returned: 0 in 0.887s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:39 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da Jun 04 14:56:39 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:40 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da" returned: 0 in 0.793s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da" released by "delete_volume" :: held 1.741s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Created reservations ['3e6c10c9-5de3-4dcf-8d54-ef9ad7bbde02', '2411c445-8523-46a5-b1ab-735198cfbc43', 'd669c96d-df4e-4fc2-9ce0-3c000295ded8', 'ee13ad3d-1546-4490-8105-6f6b953c7a4e'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:40 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:40 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-401ce0ac-f56d-4fca-8b61-74b6c4cf3a9a tempest-GroupsTest-871246982 None] Group tempest-Group1-1010399117: creating Jun 04 14:56:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-401ce0ac-f56d-4fca-8b61-74b6c4cf3a9a tempest-GroupsTest-871246982 None] Group tempest-Group1-1010399117: created successfully Jun 04 14:56:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-401ce0ac-f56d-4fca-8b61-74b6c4cf3a9a tempest-GroupsTest-871246982 None] Create group completed successfully. Jun 04 14:56:41 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.954s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Deleted volume successfully. Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-98868149-feb0-4c76-9e37-63931536b3ab tempest-VolumesActionsTest-1354247408 None] Lock "cinder-a2ae7f79-9848-45fa-89d6-e2a8ba4bb3da-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (b031c2f9-fda4-43cf-8be9-0e12556cfe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f189e7-20c4-48b1-aba9-05efb886ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f189e7-20c4-48b1-aba9-05efb886ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-621983102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d718261a-e97a-4f8a-a0df-0b4b24f3317b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:41Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed83f9a7-0c07-45b2-a632-a2ab0a73c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed83f9a7-0c07-45b2-a632-a2ab0a73c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c85e1a-0828-4ffa-8e3b-be129226ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c85e1a-0828-4ffa-8e3b-be129226ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd718261a-e97a-4f8a-a0df-0b4b24f3317b', 'volume_name': 'volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd3c30-2c19-45f5-9793-5e2a4910ec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd3c30-2c19-45f5-9793-5e2a4910ec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f5782d-de2b-46ce-b202-575924a210b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Volume d718261a-e97a-4f8a-a0df-0b4b24f3317b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b', 'volume_size': 1} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-621983102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d718261a-e97a-4f8a-a0df-0b4b24f3317b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:41Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Creating volume d718261a-e97a-4f8a-a0df-0b4b24f3317b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:41 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:41 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b 1073741824 Jun 04 14:56:41 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-56e710ea-db62-472b-acb7-bf414fac2cce tempest-GroupsTest-871246982 None] Group tempest-Group2-709601345: creating Jun 04 14:56:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-56e710ea-db62-472b-acb7-bf414fac2cce tempest-GroupsTest-871246982 None] Group tempest-Group2-709601345: created successfully Jun 04 14:56:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-56e710ea-db62-472b-acb7-bf414fac2cce tempest-GroupsTest-871246982 None] Create group completed successfully. Jun 04 14:56:42 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b 1073741824" returned: 0 in 1.342s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:42 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b Jun 04 14:56:42 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:44 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b" returned: 0 in 1.083s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f5782d-de2b-46ce-b202-575924a210b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9661ba18-2abb-4ae9-a6bc-9637c95031e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:44 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Volume volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b (d718261a-e97a-4f8a-a0df-0b4b24f3317b): created successfully Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9661ba18-2abb-4ae9-a6bc-9637c95031e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (b031c2f9-fda4-43cf-8be9-0e12556cfe2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-bfb641a9-cbcf-4204-9a01-09c09cb6d7c9 tempest-VolumesActionsTest-1420519143 None] Created volume successfully. Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Flow 'volume_create_manager' (40be892a-2add-4c20-80c8-5cc4831e3156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a18ca75-6ac8-44ad-8498-0790311524bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a18ca75-6ac8-44ad-8498-0790311524bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1298467716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17961f8e-9935-4972-bc97-269ca0b81189,host='devstack@QuobyteHD#QuobyteHD',id=355565e8-93fe-4d27-aa86-f5bd568d298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a9685fca51416c9d34965bf85d6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:44Z,use_quota=True,user_id='2b9d0f3ca7674763968a0a08281fd1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bc4b311-f964-4597-b993-8a161ad5cc1c),volume_type_id=7bc4b311-f964-4597-b993-8a161ad5cc1c)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3143cae8-ab59-4911-8fe6-8543a72b415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3143cae8-ab59-4911-8fe6-8543a72b415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721514e6-961e-467e-8a8e-6d841ad705be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721514e6-961e-467e-8a8e-6d841ad705be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355565e8-93fe-4d27-aa86-f5bd568d298b', 'volume_name': 'volume-355565e8-93fe-4d27-aa86-f5bd568d298b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c1dfac-3522-448c-8e36-41475a52e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c1dfac-3522-448c-8e36-41475a52e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcf1c85-e1ee-496f-a373-e1d7318a5ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:44 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Volume 355565e8-93fe-4d27-aa86-f5bd568d298b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355565e8-93fe-4d27-aa86-f5bd568d298b', 'volume_size': 1} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17961f8e-9935-4972-bc97-269ca0b81189,created_at=2026-06-04T12:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1298467716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17961f8e-9935-4972-bc97-269ca0b81189,host='devstack@QuobyteHD#QuobyteHD',id=355565e8-93fe-4d27-aa86-f5bd568d298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a9685fca51416c9d34965bf85d6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:44Z,use_quota=True,user_id='2b9d0f3ca7674763968a0a08281fd1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bc4b311-f964-4597-b993-8a161ad5cc1c),volume_type_id=7bc4b311-f964-4597-b993-8a161ad5cc1c)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Creating volume 355565e8-93fe-4d27-aa86-f5bd568d298b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:44 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:44 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b 1073741824 Jun 04 14:56:44 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-d718261a-e97a-4f8a-a0df-0b4b24f3317b-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Lock "cinder-d718261a-e97a-4f8a-a0df-0b4b24f3317b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-quobyte-d718261a-e97a-4f8a-a0df-0b4b24f3317b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-d718261a-e97a-4f8a-a0df-0b4b24f3317b" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9440b69c-05c1-4f41-879f-e657faacf29f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:45 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b Jun 04 14:56:45 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:45 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b 1073741824" returned: 0 in 1.230s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:45 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b Jun 04 14:56:45 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:46 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b" returned: 0 in 1.058s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:46 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b Jun 04 14:56:46 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:46 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b" returned: 0 in 1.205s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcf1c85-e1ee-496f-a373-e1d7318a5ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355565e8-93fe-4d27-aa86-f5bd568d298b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d873a801-a39e-42e8-a074-88f8cf6935fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:46 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Volume volume-355565e8-93fe-4d27-aa86-f5bd568d298b (355565e8-93fe-4d27-aa86-f5bd568d298b): created successfully Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d873a801-a39e-42e8-a074-88f8cf6935fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Flow 'volume_create_manager' (40be892a-2add-4c20-80c8-5cc4831e3156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-52f1d997-fe56-4781-bf8e-b766f0d7e600 tempest-GroupsTest-871246982 None] Created volume successfully. Jun 04 14:56:47 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d718261a-e97a-4f8a-a0df-0b4b24f3317b" returned: 0 in 0.996s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-d718261a-e97a-4f8a-a0df-0b4b24f3317b" released by "delete_volume" :: held 2.118s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Created reservations ['c29f4d5d-71b6-4572-8395-43740ccf47fa', '29fb4897-f7d4-45fc-bf3c-06b5e1add687', '044808ea-79cd-4ddd-b0a1-9be7598b63ac', 'b0f885d7-cac0-42fa-a596-dd39666e8a59'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:47 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:47 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:48 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.984s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Deleted volume successfully. Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Acquiring lock "cinder-quobyte-355565e8-93fe-4d27-aa86-f5bd568d298b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b8ac9bab-ea3b-4cd3-a3b5-d1d6cc127d6d tempest-VolumesActionsTest-1354247408 None] Lock "cinder-d718261a-e97a-4f8a-a0df-0b4b24f3317b-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Lock "cinder-quobyte-355565e8-93fe-4d27-aa86-f5bd568d298b" acquired by "delete_volume" :: waited 0.047s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[384eb951-e24f-4a6d-a2a2-2f911e318946]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:48 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b Jun 04 14:56:48 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (8d53ba86-6754-4e0d-8120-bd9cfdca6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3455f4-4c4c-4ef9-b54d-414320c97246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3455f4-4c4c-4ef9-b54d-414320c97246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1750904683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb683c36-d888-43a8-9709-fe32fede252d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:49Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12871fe7-491b-4cc0-b6ad-edd1229b7a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12871fe7-491b-4cc0-b6ad-edd1229b7a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f86cb6-99a2-4bc0-bda4-0d1f7987f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f86cb6-99a2-4bc0-bda4-0d1f7987f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb683c36-d888-43a8-9709-fe32fede252d', 'volume_name': 'volume-fb683c36-d888-43a8-9709-fe32fede252d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26259c79-1c2c-4c72-b8f0-adb09c01d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26259c79-1c2c-4c72-b8f0-adb09c01d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221dfc9d-ae18-41c0-ae74-956f11faf562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:49 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Volume fb683c36-d888-43a8-9709-fe32fede252d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb683c36-d888-43a8-9709-fe32fede252d', 'volume_size': 1} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1750904683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb683c36-d888-43a8-9709-fe32fede252d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:49Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Creating volume fb683c36-d888-43a8-9709-fe32fede252d {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:49 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:49 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d 1073741824 Jun 04 14:56:49 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:49 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b" returned: 0 in 1.062s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:49 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b Jun 04 14:56:49 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:50 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-355565e8-93fe-4d27-aa86-f5bd568d298b" returned: 0 in 0.954s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Lock "cinder-quobyte-355565e8-93fe-4d27-aa86-f5bd568d298b" released by "delete_volume" :: held 2.087s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Created reservations ['2eaf273e-c736-4bc0-8d64-dd9ecbf6d542'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:50 devstack cinder-volume[86522]: WARNING cinder.quota [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1656787981 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1656787981, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:56:50 devstack cinder-volume[86522]: WARNING cinder.quota [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1656787981 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1656787981, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Created reservations ['deb54dae-cd20-4e3d-aee7-bb8bd53f1723', '2d97ff1c-688f-44dc-b10d-3286bec4d89f', '642fe972-05e4-4209-ae44-9d90675edc1e', '40766c14-8477-4f8f-ae80-ff1a330ec6c7'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:50 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d 1073741824" returned: 0 in 1.563s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Flow 'volume_create_manager' (2f96abd8-1d89-44ed-8bef-71248612c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd24b234-30de-416c-a6dc-d73803b96fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd24b234-30de-416c-a6dc-d73803b96fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0449b4-ba69-4705-9435-5f462785f612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2effe3541c544beb8c5d07ca1e55cace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:51Z,use_quota=True,user_id='115ec4f29531482aabf6dfc67230210f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412454c-b3d4-411e-adcc-01d5fa8ab11b),volume_type_id=0412454c-b3d4-411e-adcc-01d5fa8ab11b)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a5bee3-dbc6-4969-810c-872c4a2f4c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a5bee3-dbc6-4969-810c-872c4a2f4c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1513c4-60e0-4787-9f4d-901429133e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:51 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d Jun 04 14:56:51 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:51 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:51 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1513c4-60e0-4787-9f4d-901429133e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e0449b4-ba69-4705-9435-5f462785f612', 'volume_name': 'volume-5e0449b4-ba69-4705-9435-5f462785f612', 'volume_size': 1, 'image_id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b39cdbd98b2150e7bac6515c4f86e0e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2effe3541c544beb8c5d07ca1e55cace', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49c7d765744ef58f82de62a6032d90d0a35f69769e473437c039fa6f49d6a688339835323ab49d43e7ba910b59218eb0a9d7d9e3d7b9eedbf4020ec5e5026ca4', 'id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'created_at': datetime.datetime(2026, 6, 4, 12, 56, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb66fb81-653b-491f-b660-756f9d20f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb66fb81-653b-491f-b660-756f9d20f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e345fcd-1f36-45d8-8110-9dce71596055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:51 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Volume 5e0449b4-ba69-4705-9435-5f462785f612: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e0449b4-ba69-4705-9435-5f462785f612', 'volume_size': 1, 'image_id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b39cdbd98b2150e7bac6515c4f86e0e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2effe3541c544beb8c5d07ca1e55cace', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49c7d765744ef58f82de62a6032d90d0a35f69769e473437c039fa6f49d6a688339835323ab49d43e7ba910b59218eb0a9d7d9e3d7b9eedbf4020ec5e5026ca4', 'id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'created_at': datetime.datetime(2026, 6, 4, 12, 56, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Trying to clone 5e0449b4-ba69-4705-9435-5f462785f612 from image 92cac279-fcc0-49d3-8b00-a3b4a7fef74a at location (None, [{'url': 'file:///opt/stack/data/glance/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 14:56:51 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Image download 0.00 MB at 0.00 MB/s Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2748cb42-85df-4c9f-ba94-a2b5972ecaa5]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:51 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD Jun 04 14:56:51 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:51 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d" returned: 0 in 0.831s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] <== create_volume: return (2522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221dfc9d-ae18-41c0-ae74-956f11faf562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb683c36-d888-43a8-9709-fe32fede252d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaf39da-9227-4238-a75b-ce8eba96ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:51 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Volume volume-fb683c36-d888-43a8-9709-fe32fede252d (fb683c36-d888-43a8-9709-fe32fede252d): created successfully Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaf39da-9227-4238-a75b-ce8eba96ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (8d53ba86-6754-4e0d-8120-bd9cfdca6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:51 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e1dbfb3d-3639-4ab1-9251-f0993ecc38e4 tempest-VolumesActionsTest-1420519143 None] Created volume successfully. Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.855s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:51 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-be701599-4fdf-4403-bf59-a5bf24978130 tempest-GroupsTest-871246982 None] Delete group completed successfully. Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Created reservations ['c25cbcb3-9ff6-4508-9b08-599fe5fcfabb'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:52 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:52 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:52 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:52 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD Jun 04 14:56:52 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-fb683c36-d888-43a8-9709-fe32fede252d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Lock "cinder-fb683c36-d888-43a8-9709-fe32fede252d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-quobyte-fb683c36-d888-43a8-9709-fe32fede252d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-fb683c36-d888-43a8-9709-fe32fede252d" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ac71c0-ca9e-423e-90c6-382ff5842ea3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:52 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-442f489e-7ef1-4356-ab09-19eaedf1bd79 tempest-GroupsTest-871246982 None] Delete group completed successfully. Jun 04 14:56:53 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d Jun 04 14:56:53 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:53 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Temporary image 92cac279-fcc0-49d3-8b00-a3b4a7fef74a is fetched for user 115ec4f29531482aabf6dfc67230210f. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece57c32-4b18-4c2d-843d-0e2d2a7eafc4]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:53 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD Jun 04 14:56:53 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:53 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d" returned: 0 in 0.941s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:53 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d Jun 04 14:56:53 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fdf27683-3198-4078-8234-7837d9c848de tempest-GroupsTest-871246982 None] Group tempest-GroupsTest-Group-608840004: creating Jun 04 14:56:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fdf27683-3198-4078-8234-7837d9c848de tempest-GroupsTest-871246982 None] Group tempest-GroupsTest-Group-608840004: created successfully Jun 04 14:56:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fdf27683-3198-4078-8234-7837d9c848de tempest-GroupsTest-871246982 None] Create group completed successfully. Jun 04 14:56:54 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:54 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD Jun 04 14:56:54 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:54 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fb683c36-d888-43a8-9709-fe32fede252d" returned: 0 in 0.671s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-fb683c36-d888-43a8-9709-fe32fede252d" released by "delete_volume" :: held 1.672s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Created reservations ['d66453a3-0ff5-476b-8c34-bae59a0caa0a', '8932467b-84b1-45e3-b553-0be0d2e440e6', 'f9e4b171-fef9-49de-97da-b2fa4a752521', '889c7d3f-8918-4d73-9853-e6b6fa1f735d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:54 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:56:54 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:55 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD" returned: 1 in 0.989s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0449b4-ba69-4705-9435-5f462785f612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2effe3541c544beb8c5d07ca1e55cace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:51Z,use_quota=True,user_id='115ec4f29531482aabf6dfc67230210f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412454c-b3d4-411e-adcc-01d5fa8ab11b),volume_type_id=0412454c-b3d4-411e-adcc-01d5fa8ab11b)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Creating volume 5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:55 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:55 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 1073741824 Jun 04 14:56:55 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:55 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.893s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:56:55 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Deleted volume successfully. Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-58986881-1527-41c3-8406-6d61d351c28b tempest-VolumesActionsTest-1354247408 None] Lock "cinder-fb683c36-d888-43a8-9709-fe32fede252d-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Flow 'volume_create_manager' (5229fe8e-dfbe-498a-8fc0-93acf150bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15cb7cf-ab32-4c44-a831-b26e5d5fcfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15cb7cf-ab32-4c44-a831-b26e5d5fcfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-411942027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f71ec96d-45c2-4518-b1b9-7c2c7d1e6ca2,host='devstack@QuobyteHD#QuobyteHD',id=956b9e51-395b-45e8-8a8a-e09c34c53e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a9685fca51416c9d34965bf85d6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:56Z,use_quota=True,user_id='2b9d0f3ca7674763968a0a08281fd1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(303c8cc6-890f-434a-b6a4-6ae78e5e3534),volume_type_id=303c8cc6-890f-434a-b6a4-6ae78e5e3534)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8f9b45-d54d-40b6-b902-1224b0102023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8f9b45-d54d-40b6-b902-1224b0102023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4079efc-3c76-426f-9294-38bae824574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4079efc-3c76-426f-9294-38bae824574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956b9e51-395b-45e8-8a8a-e09c34c53e10', 'volume_name': 'volume-956b9e51-395b-45e8-8a8a-e09c34c53e10', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab17e381-369c-4394-873b-60d2bb102d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab17e381-369c-4394-873b-60d2bb102d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280fe952-f27b-4884-bba1-c77fa8646d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Volume 956b9e51-395b-45e8-8a8a-e09c34c53e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956b9e51-395b-45e8-8a8a-e09c34c53e10', 'volume_size': 1} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (1f819e1e-9bfb-4916-9c1e-db1e3954d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9a3b4d-c1d1-43c4-9ebe-bdd0a2927794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9a3b4d-c1d1-43c4-9ebe-bdd0a2927794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012427333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2624c9-b31c-4b88-91ca-4c23a1917bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:56Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cec3099-8b0e-4000-8f15-df00cc8b5d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cec3099-8b0e-4000-8f15-df00cc8b5d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af163fd-4314-47ab-8f91-b025f0690c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af163fd-4314-47ab-8f91-b025f0690c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2624c9-b31c-4b88-91ca-4c23a1917bbd', 'volume_name': 'volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f04df5-5670-4b75-9c87-ae214fe6d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f04df5-5670-4b75-9c87-ae214fe6d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dacc325-c995-4e37-8ad0-373ca3f9e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:55 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Volume cc2624c9-b31c-4b88-91ca-4c23a1917bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd', 'volume_size': 1} Jun 04 14:56:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:56 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 1073741824" returned: 0 in 0.904s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:56 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:56:56 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:56 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 0 in 0.601s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.056s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f71ec96d-45c2-4518-b1b9-7c2c7d1e6ca2,created_at=2026-06-04T12:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-411942027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f71ec96d-45c2-4518-b1b9-7c2c7d1e6ca2,host='devstack@QuobyteHD#QuobyteHD',id=956b9e51-395b-45e8-8a8a-e09c34c53e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a9685fca51416c9d34965bf85d6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:56Z,use_quota=True,user_id='2b9d0f3ca7674763968a0a08281fd1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(303c8cc6-890f-434a-b6a4-6ae78e5e3534),volume_type_id=303c8cc6-890f-434a-b6a4-6ae78e5e3534)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Creating volume 956b9e51-395b-45e8-8a8a-e09c34c53e10 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:56 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:56 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 1073741824 Jun 04 14:56:56 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Attempting download of 92cac279-fcc0-49d3-8b00-a3b4a7fef74a ((None, [{'url': 'file:///opt/stack/data/glance/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'metadata': {}}])) to volume 5e0449b4-ba69-4705-9435-5f462785f612. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259fe64-63b9-483d-a7cc-a65526e0fe10]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:57 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1 Jun 04 14:56:57 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:57 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1" returned: 0 in 0.719s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:57 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 1073741824" returned: 0 in 0.870s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:57 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1 Jun 04 14:56:57 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:57 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 Jun 04 14:56:57 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:58 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:58 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10" returned: 0 in 0.631s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1" returned: 1 in 0.747s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_w0krdpf1' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.534s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012427333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2624c9-b31c-4b88-91ca-4c23a1917bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:56Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Creating volume cc2624c9-b31c-4b88-91ca-4c23a1917bbd {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:56:58 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[807cc222-de09-4403-85f8-a817cb2c89b9]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:58 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd 1073741824 Jun 04 14:56:58 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280fe952-f27b-4884-bba1-c77fa8646d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956b9e51-395b-45e8-8a8a-e09c34c53e10', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fed1293-ca59-451d-bf1a-2fa0e82438ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:58 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Volume volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 (956b9e51-395b-45e8-8a8a-e09c34c53e10): created successfully Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fed1293-ca59-451d-bf1a-2fa0e82438ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Flow 'volume_create_manager' (5229fe8e-dfbe-498a-8fc0-93acf150bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-72315de3-cf3c-4e50-af55-4e2a3ffa451a tempest-GroupsTest-871246982 None] Created volume successfully. Jun 04 14:56:58 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD Jun 04 14:56:58 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:59 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:59 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd 1073741824" returned: 0 in 0.876s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:56:59 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd Jun 04 14:56:59 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:59 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD Jun 04 14:56:59 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Flow 'volume_create_manager' (5435cf69-d15a-437e-b775-33cecc93b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcad60b-7055-4d8f-83b7-7724db421d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcad60b-7055-4d8f-83b7-7724db421d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1660353509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f71ec96d-45c2-4518-b1b9-7c2c7d1e6ca2,host='devstack@QuobyteHD#QuobyteHD',id=b37cd75a-5f1b-4234-873a-5357a4a121c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a9685fca51416c9d34965bf85d6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:59Z,use_quota=True,user_id='2b9d0f3ca7674763968a0a08281fd1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(303c8cc6-890f-434a-b6a4-6ae78e5e3534),volume_type_id=303c8cc6-890f-434a-b6a4-6ae78e5e3534)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdda345-3e96-4c2c-bd3b-c36535a2829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdda345-3e96-4c2c-bd3b-c36535a2829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7f6611-5e2d-4d9f-9adf-8e1606e821ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7f6611-5e2d-4d9f-9adf-8e1606e821ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37cd75a-5f1b-4234-873a-5357a4a121c9', 'volume_name': 'volume-b37cd75a-5f1b-4234-873a-5357a4a121c9', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be257774-820d-4fb9-8457-0e6f5ea0219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be257774-820d-4fb9-8457-0e6f5ea0219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ae493a-8002-4a64-81a8-7a5a1307016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:56:59 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Volume b37cd75a-5f1b-4234-873a-5357a4a121c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37cd75a-5f1b-4234-873a-5357a4a121c9', 'volume_size': 1} Jun 04 14:56:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:00 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd" returned: 0 in 0.644s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f71ec96d-45c2-4518-b1b9-7c2c7d1e6ca2,created_at=2026-06-04T12:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1660353509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f71ec96d-45c2-4518-b1b9-7c2c7d1e6ca2,host='devstack@QuobyteHD#QuobyteHD',id=b37cd75a-5f1b-4234-873a-5357a4a121c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a9685fca51416c9d34965bf85d6907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:56:59Z,use_quota=True,user_id='2b9d0f3ca7674763968a0a08281fd1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(303c8cc6-890f-434a-b6a4-6ae78e5e3534),volume_type_id=303c8cc6-890f-434a-b6a4-6ae78e5e3534)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Creating volume b37cd75a-5f1b-4234-873a-5357a4a121c9 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:00 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:00 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:00 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 1073741824 Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dacc325-c995-4e37-8ad0-373ca3f9e534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:00 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcef665-98bd-459a-be6d-aa9c85bae6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] 92cac279-fcc0-49d3-8b00-a3b4a7fef74a was raw, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Volume volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd (cc2624c9-b31c-4b88-91ca-4c23a1917bbd): created successfully Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcef665-98bd-459a-be6d-aa9c85bae6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (1f819e1e-9bfb-4916-9c1e-db1e3954d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:00 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:57:00 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dddb80d4-229e-4f2d-bfb5-53214d8f349e tempest-VolumesActionsTest-1420519143 None] Created volume successfully. Jun 04 14:57:00 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 0 in 0.700s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92cac279-fcc0-49d3-8b00-a3b4a7fef74a_ii_wjxnqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:57:00 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:00 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 1G Jun 04 14:57:00 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:00 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 1073741824" returned: 0 in 0.814s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:00 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 Jun 04 14:57:00 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-cc2624c9-b31c-4b88-91ca-4c23a1917bbd-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Lock "cinder-cc2624c9-b31c-4b88-91ca-4c23a1917bbd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Acquiring lock "cinder-quobyte-cc2624c9-b31c-4b88-91ca-4c23a1917bbd" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-cc2624c9-b31c-4b88-91ca-4c23a1917bbd" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c9da58-a0ea-4d6a-81c6-83dc13797f6f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:01 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd Jun 04 14:57:01 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:01 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:01 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 1G" returned: 0 in 0.740s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ae493a-8002-4a64-81a8-7a5a1307016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37cd75a-5f1b-4234-873a-5357a4a121c9', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ac7876-33e5-4001-8440-ca44a78092ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:01 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Volume volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 (b37cd75a-5f1b-4234-873a-5357a4a121c9): created successfully Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ac7876-33e5-4001-8440-ca44a78092ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Flow 'volume_create_manager' (5435cf69-d15a-437e-b775-33cecc93b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9c396-9cef-47b2-b7f6-19f2b181615f]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:01 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e0f92edd-0213-4358-bb37-b219ccfd720b tempest-GroupsTest-871246982 None] Created volume successfully. Jun 04 14:57:01 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:57:01 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:02 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd" returned: 0 in 0.782s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:02 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd Jun 04 14:57:02 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:02 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 0 in 0.716s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:02 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:57:02 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:02 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cc2624c9-b31c-4b88-91ca-4c23a1917bbd" returned: 0 in 0.677s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Lock "cinder-quobyte-cc2624c9-b31c-4b88-91ca-4c23a1917bbd" released by "delete_volume" :: held 1.511s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:02 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Created reservations ['bbfceb91-b4e6-46d8-96fc-2d0b8051245e', '3520d4d8-caa6-4c78-8302-2c9515f8be2b', '14f51824-57bd-4006-a765-1142532911fe', 'a0a0598e-c40a-4247-88a8-96d07c84b5d8'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-89ee42f2-5cc9-483f-9c88-8c070d03fd48 tempest-GroupsTest-871246982 None] Update group completed successfully. Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:03 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:03 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:03 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 1 in 0.896s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Downloaded image 92cac279-fcc0-49d3-8b00-a3b4a7fef74a ((None, [{'url': 'file:///opt/stack/data/glance/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'metadata': {}}])) to volume 5e0449b4-ba69-4705-9435-5f462785f612 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Temporary image 92cac279-fcc0-49d3-8b00-a3b4a7fef74a for user 115ec4f29531482aabf6dfc67230210f is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Marking volume 5e0449b4-ba69-4705-9435-5f462785f612 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Copying metadata from image 92cac279-fcc0-49d3-8b00-a3b4a7fef74a to 5e0449b4-ba69-4705-9435-5f462785f612. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Creating volume glance metadata for volume 5e0449b4-ba69-4705-9435-5f462785f612 backed by image 92cac279-fcc0-49d3-8b00-a3b4a7fef74a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b39cdbd98b2150e7bac6515c4f86e0e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e345fcd-1f36-45d8-8110-9dce71596055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0449b4-ba69-4705-9435-5f462785f612', 'volume_size': 1, 'image_id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b39cdbd98b2150e7bac6515c4f86e0e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2effe3541c544beb8c5d07ca1e55cace', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49c7d765744ef58f82de62a6032d90d0a35f69769e473437c039fa6f49d6a688339835323ab49d43e7ba910b59218eb0a9d7d9e3d7b9eedbf4020ec5e5026ca4', 'id': '92cac279-fcc0-49d3-8b00-a3b4a7fef74a', 'created_at': datetime.datetime(2026, 6, 4, 12, 56, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92cac279-fcc0-49d3-8b00-a3b4a7fef74a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ec98c3-94a8-4820-8a23-1af345226a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:03 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Volume volume-5e0449b4-ba69-4705-9435-5f462785f612 (5e0449b4-ba69-4705-9435-5f462785f612): created successfully Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ec98c3-94a8-4820-8a23-1af345226a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Flow 'volume_create_manager' (2f96abd8-1d89-44ed-8bef-71248612c47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-531db0c5-1445-4b2c-b47e-893c86de80d9 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Created volume successfully. Jun 04 14:57:03 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.682s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Deleted volume successfully. Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-43555d6e-f1a0-468d-b977-4925de70fa84 tempest-VolumesActionsTest-1354247408 None] Lock "cinder-cc2624c9-b31c-4b88-91ca-4c23a1917bbd-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:03 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (e1d6fdd3-7e34-439c-b13f-89c6d485c36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201282df-5f77-4642-bfa3-5182e5771357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201282df-5f77-4642-bfa3-5182e5771357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1038034843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0052614-c57f-44e0-8f70-a60ab05db04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:04Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e282dfc-0721-4afd-bc0c-d855c641c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e282dfc-0721-4afd-bc0c-d855c641c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9dcb05-4c2d-4fad-9de0-b2e02d1f8223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9dcb05-4c2d-4fad-9de0-b2e02d1f8223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0052614-c57f-44e0-8f70-a60ab05db04a', 'volume_name': 'volume-e0052614-c57f-44e0-8f70-a60ab05db04a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35f6aeb-929d-4cc2-8b85-9e97fbea76f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35f6aeb-929d-4cc2-8b85-9e97fbea76f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca766cd-a859-4cc8-be4d-7bc8b9cc0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:04 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Volume e0052614-c57f-44e0-8f70-a60ab05db04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0052614-c57f-44e0-8f70-a60ab05db04a', 'volume_size': 1} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1038034843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0052614-c57f-44e0-8f70-a60ab05db04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926c3e0d00784cd592a8c7dcba461bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:04Z,use_quota=True,user_id='075c8af87c9542b58b2ea8c24dd14588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Creating volume e0052614-c57f-44e0-8f70-a60ab05db04a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:04 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:04 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a 1073741824 Jun 04 14:57:04 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Acquiring lock "cinder-5e0449b4-ba69-4705-9435-5f462785f612-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "cinder-5e0449b4-ba69-4705-9435-5f462785f612-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Acquiring lock "cinder-quobyte-5e0449b4-ba69-4705-9435-5f462785f612" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "cinder-quobyte-5e0449b4-ba69-4705-9435-5f462785f612" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a8a70ecb-c2a1-49ba-93a1-ea3777405582 tempest-GroupsTest-871246982 None] Update group completed successfully. Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[070abcbe-c32b-40d4-b9b1-f4bd1129ecc6]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:04 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:57:04 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:04 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a 1073741824" returned: 0 in 0.883s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:05 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a Jun 04 14:57:05 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:05 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 0 in 0.713s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:05 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:57:05 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:05 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a" returned: 0 in 0.651s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca766cd-a859-4cc8-be4d-7bc8b9cc0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0052614-c57f-44e0-8f70-a60ab05db04a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d2bd34-f55c-4636-bd4b-1fce49bb751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Volume volume-e0052614-c57f-44e0-8f70-a60ab05db04a (e0052614-c57f-44e0-8f70-a60ab05db04a): created successfully Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d2bd34-f55c-4636-bd4b-1fce49bb751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Flow 'volume_create_manager' (e1d6fdd3-7e34-439c-b13f-89c6d485c36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:05 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-60a841ee-9227-4980-9ae4-73cabe7f3219 tempest-VolumesActionsTest-1420519143 None] Created volume successfully. Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Acquiring lock "cinder-quobyte-956b9e51-395b-45e8-8a8a-e09c34c53e10" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Lock "cinder-quobyte-956b9e51-395b-45e8-8a8a-e09c34c53e10" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:05 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 1 in 0.724s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c8d6f-6af4-40b4-b8d5-ac749f2987a7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:05 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612 Jun 04 14:57:05 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:06 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 Jun 04 14:57:06 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:06 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5e0449b4-ba69-4705-9435-5f462785f612" returned: 0 in 0.600s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "cinder-quobyte-5e0449b4-ba69-4705-9435-5f462785f612" released by "delete_volume" :: held 2.114s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:06 devstack cinder-volume[86522]: WARNING cinder.quota [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:57:06 devstack cinder-volume[86522]: WARNING cinder.quota [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Created reservations ['efc2fe36-3ae0-4168-9f6b-8ede40b41c1a', 'f3488e6b-913d-4f1d-aef2-ed25bdb6c881', 'a59015bd-03c7-4a5a-afe7-ededd94417f4', 'fe5065be-f300-4cfa-bb62-2ab004abea5c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:06 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:06 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:06 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10" returned: 0 in 0.821s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:06 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10 Jun 04 14:57:06 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "cinder-e0052614-c57f-44e0-8f70-a60ab05db04a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-e0052614-c57f-44e0-8f70-a60ab05db04a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "cinder-quobyte-e0052614-c57f-44e0-8f70-a60ab05db04a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-quobyte-e0052614-c57f-44e0-8f70-a60ab05db04a" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2402c7-b615-490d-8aa2-33c684abf929]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:07 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a Jun 04 14:57:07 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:07 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.709s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Deleted volume successfully. Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a448d54f-7bac-4fc3-8d53-6b97e23a9e93 tempest-VolumeAndVolumeTypeFromImageTest-209271983 None] Lock "cinder-5e0449b4-ba69-4705-9435-5f462785f612-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:07 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-956b9e51-395b-45e8-8a8a-e09c34c53e10" returned: 0 in 0.817s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Lock "cinder-quobyte-956b9e51-395b-45e8-8a8a-e09c34c53e10" released by "delete_volume" :: held 1.719s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Acquiring lock "cinder-quobyte-b37cd75a-5f1b-4234-873a-5357a4a121c9" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Lock "cinder-quobyte-b37cd75a-5f1b-4234-873a-5357a4a121c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c96a4-a70b-4304-9346-42d91bdf5d4a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:07 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 Jun 04 14:57:07 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:07 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a" returned: 0 in 0.900s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:07 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a Jun 04 14:57:07 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=118,cinder:UPDATE=150,cinder:INSERT=33,cinder:DELETE=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=145,cinder:SELECT=122,cinder:INSERT=43,cinder:DELETE=14 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Flow 'volume_create_manager' (0441aa07-bdd0-47cc-ba10-125a243b7856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dece524-7fed-408a-ba26-d180949cece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dece524-7fed-408a-ba26-d180949cece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2134393911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6009c9-69e4-4909-8295-9ab82af8783c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb5aa37335e4df1819c52343f9a1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:08Z,use_quota=True,user_id='e1e3936c3f1447e29ec8faeadc7b5e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6977a1d-ce72-4f4b-8ede-2fa561bf5e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6977a1d-ce72-4f4b-8ede-2fa561bf5e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231b28a1-186f-4a49-bad9-0190d7a0f3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231b28a1-186f-4a49-bad9-0190d7a0f3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6009c9-69e4-4909-8295-9ab82af8783c', 'volume_name': 'volume-4f6009c9-69e4-4909-8295-9ab82af8783c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bb28c1-512f-4abd-9ec2-f334d398077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bb28c1-512f-4abd-9ec2-f334d398077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b91425-56f9-4d59-8d5b-eff04c09d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:08 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Volume 4f6009c9-69e4-4909-8295-9ab82af8783c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6009c9-69e4-4909-8295-9ab82af8783c', 'volume_size': 1} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2134393911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6009c9-69e4-4909-8295-9ab82af8783c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb5aa37335e4df1819c52343f9a1331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:08Z,use_quota=True,user_id='e1e3936c3f1447e29ec8faeadc7b5e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Creating volume 4f6009c9-69e4-4909-8295-9ab82af8783c {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:08 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:08 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c 1073741824 Jun 04 14:57:08 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:08 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9" returned: 0 in 0.895s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:08 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9 Jun 04 14:57:08 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:08 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e0052614-c57f-44e0-8f70-a60ab05db04a" returned: 0 in 0.749s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-quobyte-e0052614-c57f-44e0-8f70-a60ab05db04a" released by "delete_volume" :: held 1.705s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Created reservations ['e735a2c6-d478-4533-811a-f6d3fdb1b8e3', 'e20834de-53d7-4131-b296-280b553a195b', '757e9141-9e48-416f-bf56-84d953931244', 'dc757943-a757-4f90-81f5-101c3cde4206'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:08 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:08 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:09 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b37cd75a-5f1b-4234-873a-5357a4a121c9" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Lock "cinder-quobyte-b37cd75a-5f1b-4234-873a-5357a4a121c9" released by "delete_volume" :: held 1.696s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Created reservations ['580a33b5-14eb-499e-a461-d6326cdfbb36'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:09 devstack cinder-volume[86522]: WARNING cinder.quota [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-630746129 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-630746129, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:57:09 devstack cinder-volume[86522]: WARNING cinder.quota [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-630746129 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-630746129, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Created reservations ['9d7ade73-a9d3-4833-b9a7-7d732b67f185', '0ad5b831-4aa7-416d-b3a2-16503abde67e', '3fdab9c4-aee5-48ed-a905-58d67be7527e', '9a71638e-0a14-42ec-966a-c5e5081d3716'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:09 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c 1073741824" returned: 0 in 1.225s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:09 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:09 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c Jun 04 14:57:09 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.926s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:09 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Deleted volume successfully. Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-564466d8-c209-4bc5-9644-a37ddc236a24 tempest-VolumesActionsTest-1420519143 None] Lock "cinder-e0052614-c57f-44e0-8f70-a60ab05db04a-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Created reservations ['69d9d94b-c9fd-4074-88b7-0b1ca7fd1bce', '701cb0e6-566b-45b4-9eea-e88b54ac02b1', 'a7bdc83d-8e0d-4836-a926-3f55897beb2f', '5a3d56e6-a851-4fee-8af5-4368da602a02'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:09 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:09 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:10 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c" returned: 0 in 0.703s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b91425-56f9-4d59-8d5b-eff04c09d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6009c9-69e4-4909-8295-9ab82af8783c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223929ff-aab6-4421-8d04-2184c8f949dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Volume volume-4f6009c9-69e4-4909-8295-9ab82af8783c (4f6009c9-69e4-4909-8295-9ab82af8783c): created successfully Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223929ff-aab6-4421-8d04-2184c8f949dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Flow 'volume_create_manager' (0441aa07-bdd0-47cc-ba10-125a243b7856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8e60aa61-1034-4368-aaff-0e656723e368 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Created volume successfully. Jun 04 14:57:10 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.935s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:10 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2bf5198d-46a2-4a0a-96bd-14e772eb033d tempest-GroupsTest-871246982 None] Delete group completed successfully. Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (0a2d8c0d-ad4f-496e-ac25-df0bccb4cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50516ea8-e397-4a8f-bd6b-d854417af091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50516ea8-e397-4a8f-bd6b-d854417af091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190238840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f147e8a7-ce55-43ff-b602-8f7382781d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:13Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c7d594-1ae5-4b9b-86d2-cd3adb097015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c7d594-1ae5-4b9b-86d2-cd3adb097015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba76569-7d69-4f8d-a7c0-2cf2758e97af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba76569-7d69-4f8d-a7c0-2cf2758e97af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f147e8a7-ce55-43ff-b602-8f7382781d71', 'volume_name': 'volume-f147e8a7-ce55-43ff-b602-8f7382781d71', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb2ca05-4e34-45af-afe1-8fd4728ae579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb2ca05-4e34-45af-afe1-8fd4728ae579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4266750c-b256-43a4-b676-52801eab1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:13 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume f147e8a7-ce55-43ff-b602-8f7382781d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f147e8a7-ce55-43ff-b602-8f7382781d71', 'volume_size': 1} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190238840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f147e8a7-ce55-43ff-b602-8f7382781d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:13Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating volume f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:13 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 1073741824 Jun 04 14:57:13 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:14 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 1073741824" returned: 0 in 1.039s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:14 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 Jun 04 14:57:14 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:15 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71" returned: 0 in 0.682s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.055s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4266750c-b256-43a4-b676-52801eab1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f147e8a7-ce55-43ff-b602-8f7382781d71', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4acf46f-d646-493b-bf47-004d3c15766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[73291197-49ff-4e73-9c57-efa964e3379d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume volume-f147e8a7-ce55-43ff-b602-8f7382781d71 (f147e8a7-ce55-43ff-b602-8f7382781d71): created successfully Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4acf46f-d646-493b-bf47-004d3c15766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (0a2d8c0d-ad4f-496e-ac25-df0bccb4cd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d86030f1-eeae-421f-85a0-e0bb51db7354 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created volume successfully. Jun 04 14:57:15 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c Jun 04 14:57:15 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:16 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c" returned: 0 in 0.827s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.340s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating offline snapshot 644d255c-346b-4780-b084-1e350a48f364 of volume f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb93e4f-a5a0-41be-8e0d-e138fdd98697]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-4f6009c9-69e4-4909-8295-9ab82af8783c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df046365-34d3-4f7a-8c0d-03686b9a4520', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:57:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-a1bf3726-0653-42f3-accf-1a2ce1ed01f9 req-c1e24613-0035-49d8-8a26-51e33aef59d9 tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] attachment_update completed successfully. Jun 04 14:57:16 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 Jun 04 14:57:16 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:17 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71" returned: 0 in 0.989s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:17 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 1G Jun 04 14:57:17 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:18 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 1G" returned: 0 in 1.106s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f147e8a7-ce55-43ff-b602-8f7382781d71 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:18 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f147e8a7-ce55-43ff-b602-8f7382781d71 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 Jun 04 14:57:18 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:19 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f147e8a7-ce55-43ff-b602-8f7382781d71 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364" returned: 0 in 0.812s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:19 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 is being set with open permissions: ugo+rw Jun 04 14:57:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:19 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 Jun 04 14:57:19 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:19 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364" returned: 0 in 0.739s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:19 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info Jun 04 14:57:19 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:20 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:20 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info is being set with open permissions: ugo+rw Jun 04 14:57:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:20 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info Jun 04 14:57:20 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:21 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.info" returned: 0 in 0.723s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.334s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ea9e507d-98ab-4a83-b7a1-90d0bd03da40 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Create snapshot completed successfully Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:22 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:22 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (42c4e4f6-6955-487f-85ea-c1d7872735d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318d8202-13c2-4efc-8b64-fa4b22ede869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318d8202-13c2-4efc-8b64-fa4b22ede869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431665934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1420faf-2cb8-413d-9eaf-9045e3dc53b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:23Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a6f441-e454-4a25-8704-e61d698ebaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a6f441-e454-4a25-8704-e61d698ebaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ef12cc-3590-4a4f-9286-5c4e2e739d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ef12cc-3590-4a4f-9286-5c4e2e739d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1420faf-2cb8-413d-9eaf-9045e3dc53b2', 'volume_name': 'volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1273ce96-1721-4d2a-aad1-5c9f0a3f0c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1273ce96-1721-4d2a-aad1-5c9f0a3f0c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7653e7-3d2b-4fb0-a00a-8354d38ad951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:22 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume f1420faf-2cb8-413d-9eaf-9045e3dc53b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2', 'volume_size': 1} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431665934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1420faf-2cb8-413d-9eaf-9045e3dc53b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:23Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating volume f1420faf-2cb8-413d-9eaf-9045e3dc53b2 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:22 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:22 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 1073741824 Jun 04 14:57:22 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (c5d8a4e0-69f9-40b8-9464-e578eea6bfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01f0d5-90f9-4236-9ea7-942aa8cf0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01f0d5-90f9-4236-9ea7-942aa8cf0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367204933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64a437e-d834-48c5-b5a3-2e3d8552ec11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:23Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34025fa-8fcd-411f-9ad7-19a5768e8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34025fa-8fcd-411f-9ad7-19a5768e8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060317c6-bf6d-4483-9e5a-71e7e8f0af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060317c6-bf6d-4483-9e5a-71e7e8f0af27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64a437e-d834-48c5-b5a3-2e3d8552ec11', 'volume_name': 'volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae127ad2-8a38-4603-b4bc-66dc73a72603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae127ad2-8a38-4603-b4bc-66dc73a72603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6ed922-b80d-4d4a-a875-0f508b11f819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume b64a437e-d834-48c5-b5a3-2e3d8552ec11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11', 'volume_size': 1} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.893s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (31feffed-b4e5-44e0-95b2-7c93ec8c1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798d6f2f-5f8f-4d75-9dc3-45ca6eaeaae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798d6f2f-5f8f-4d75-9dc3-45ca6eaeaae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225570307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95234710-9628-469a-84fa-0c6d788fc6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:24Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdb1c40-496a-4e7d-bf26-5ec347cb7285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdb1c40-496a-4e7d-bf26-5ec347cb7285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af34072-cd4a-4e54-9b20-dc2d35375c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af34072-cd4a-4e54-9b20-dc2d35375c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95234710-9628-469a-84fa-0c6d788fc6c0', 'volume_name': 'volume-95234710-9628-469a-84fa-0c6d788fc6c0', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada3b34c-898c-4485-945a-dd51b18e1818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada3b34c-898c-4485-945a-dd51b18e1818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffb515e-3f00-42bd-b0c3-291eb702b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:23 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume 95234710-9628-469a-84fa-0c6d788fc6c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95234710-9628-469a-84fa-0c6d788fc6c0', 'volume_size': 1} Jun 04 14:57:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:24 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 1073741824" returned: 0 in 1.411s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:24 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 Jun 04 14:57:24 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (878de65a-f917-4f00-812e-13df653d167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8847bb-17fd-4dd3-8d3d-aa7e4aa38c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8847bb-17fd-4dd3-8d3d-aa7e4aa38c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1142878210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eaed51-0899-4f79-9d49-af44c7455ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:25Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b436e-85bc-4b53-8516-dc9d64bbfcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b436e-85bc-4b53-8516-dc9d64bbfcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaed9b4-dbcf-4556-bedd-b1382379bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaed9b4-dbcf-4556-bedd-b1382379bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35eaed51-0899-4f79-9d49-af44c7455ea7', 'volume_name': 'volume-35eaed51-0899-4f79-9d49-af44c7455ea7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58a586b-ea68-4c10-b551-09deed4ccd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58a586b-ea68-4c10-b551-09deed4ccd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b509256-ab45-42ce-bdf1-295335c3b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:24 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume 35eaed51-0899-4f79-9d49-af44c7455ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35eaed51-0899-4f79-9d49-af44c7455ea7', 'volume_size': 1} Jun 04 14:57:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:25 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (429955f6-8832-4d73-a8ae-76c35394e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c9e305-f654-4bf3-ad6a-b0150506ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2" returned: 0 in 1.030s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.508s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367204933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64a437e-d834-48c5-b5a3-2e3d8552ec11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:23Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating volume b64a437e-d834-48c5-b5a3-2e3d8552ec11 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:25 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c9e305-f654-4bf3-ad6a-b0150506ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944991460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0203b084-7b48-4a19-99cc-fb612dbe0638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:25Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c313d27d-4c70-472d-986b-c82e986aac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c313d27d-4c70-472d-986b-c82e986aac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d303ccd-fef1-4800-ad08-2dcbb7e151bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d303ccd-fef1-4800-ad08-2dcbb7e151bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0203b084-7b48-4a19-99cc-fb612dbe0638', 'volume_name': 'volume-0203b084-7b48-4a19-99cc-fb612dbe0638', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b28599c-01cd-4bf4-b631-85dba3d6eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:25 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 1073741824 Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b28599c-01cd-4bf4-b631-85dba3d6eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:25 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c449d2-5e0c-4d15-a5d3-e0ffcf94c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:25 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume 0203b084-7b48-4a19-99cc-fb612dbe0638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0203b084-7b48-4a19-99cc-fb612dbe0638', 'volume_size': 1} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7653e7-3d2b-4fb0-a00a-8354d38ad951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1f324f-9af6-48f6-9abb-fef87b60efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:25 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 (f1420faf-2cb8-413d-9eaf-9045e3dc53b2): created successfully Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1f324f-9af6-48f6-9abb-fef87b60efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (42c4e4f6-6955-487f-85ea-c1d7872735d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5f3ede35-e04e-44cd-862f-bdf6617c708d tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created volume successfully. Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Flow 'volume_create_manager' (47e026f0-3ea3-4927-8ec5-25cf841523c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cefb1d5-1480-4e98-a506-abbc587e31f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cefb1d5-1480-4e98-a506-abbc587e31f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-164004227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5308f0a2-2a8c-4733-925f-ad44e895e317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb1c86f7f0549c387fa105cd9b913b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:26Z,use_quota=True,user_id='0234cd109b874e3583ffbe286e27046c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf91d7d4-3b72-4068-b6e4-a022e14c5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf91d7d4-3b72-4068-b6e4-a022e14c5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf61035-5475-4469-8c11-32219b493d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf61035-5475-4469-8c11-32219b493d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5308f0a2-2a8c-4733-925f-ad44e895e317', 'volume_name': 'volume-5308f0a2-2a8c-4733-925f-ad44e895e317', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36336232-f5d9-4a68-8c1a-b439916326dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36336232-f5d9-4a68-8c1a-b439916326dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c5a798-0608-4473-9683-2ee239ec2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:26 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Volume 5308f0a2-2a8c-4733-925f-ad44e895e317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5308f0a2-2a8c-4733-925f-ad44e895e317', 'volume_size': 1} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:26 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 1073741824" returned: 0 in 1.084s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:26 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 Jun 04 14:57:26 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:27 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11" returned: 0 in 0.681s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.135s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225570307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95234710-9628-469a-84fa-0c6d788fc6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:24Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating volume 95234710-9628-469a-84fa-0c6d788fc6c0 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:27 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:27 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 1073741824 Jun 04 14:57:27 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6ed922-b80d-4d4a-a875-0f508b11f819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda31190-41d4-46ee-bc1f-02850691155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:27 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 (b64a437e-d834-48c5-b5a3-2e3d8552ec11): created successfully Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda31190-41d4-46ee-bc1f-02850691155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (c5d8a4e0-69f9-40b8-9464-e578eea6bfbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Flow 'volume_create_manager' (e6030934-23f7-41ac-b089-04cc8744868f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9121489-dea1-4393-98d7-64de96bd125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-9c8e922a-2bfb-4133-8996-2ad25e782127 req-9429a129-1755-4970-bcaf-cd3ce00500ee tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Terminate volume connection completed successfully. Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-9c8e922a-2bfb-4133-8996-2ad25e782127 req-9429a129-1755-4970-bcaf-cd3ce00500ee tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Deleting attachment df046365-34d3-4f7a-8c0d-03686b9a4520. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:57:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f0ca3c74-fefa-49e3-8de7-c6aed6993ade tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created volume successfully. Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9121489-dea1-4393-98d7-64de96bd125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-255160227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f910e37-0531-423f-8f43-3d40fe594748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ab243facc9419e9b95bc4a0044c477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:27Z,use_quota=True,user_id='0340f0caddc34b2498dbb161889acd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee55fec-ac35-4431-9d95-f0eec47170e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee55fec-ac35-4431-9d95-f0eec47170e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b20cd86-a5aa-46ca-b81b-67be9026da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b20cd86-a5aa-46ca-b81b-67be9026da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f910e37-0531-423f-8f43-3d40fe594748', 'volume_name': 'volume-9f910e37-0531-423f-8f43-3d40fe594748', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193f0d15-2ecb-4e49-9822-263971196190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193f0d15-2ecb-4e49-9822-263971196190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44317a7c-1d66-44a6-b521-c4877a7977e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:27 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Volume 9f910e37-0531-423f-8f43-3d40fe594748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f910e37-0531-423f-8f43-3d40fe594748', 'volume_size': 1} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:27 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 1073741824" returned: 0 in 0.815s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:27 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 Jun 04 14:57:27 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:28 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0" returned: 0 in 0.565s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.826s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1142878210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eaed51-0899-4f79-9d49-af44c7455ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:25Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating volume 35eaed51-0899-4f79-9d49-af44c7455ea7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:28 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:28 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 1073741824 Jun 04 14:57:28 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffb515e-3f00-42bd-b0c3-291eb702b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95234710-9628-469a-84fa-0c6d788fc6c0', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d929d87-0403-4bc6-8b92-1ee2cdd1bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:28 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume volume-95234710-9628-469a-84fa-0c6d788fc6c0 (95234710-9628-469a-84fa-0c6d788fc6c0): created successfully Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d929d87-0403-4bc6-8b92-1ee2cdd1bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (31feffed-b4e5-44e0-95b2-7c93ec8c1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-192ea430-fb76-4efb-83ed-dedfa3a28794 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created volume successfully. Jun 04 14:57:29 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 1073741824" returned: 0 in 0.784s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:29 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 Jun 04 14:57:29 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Acquiring lock "cinder-4f6009c9-69e4-4909-8295-9ab82af8783c-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "cinder-4f6009c9-69e4-4909-8295-9ab82af8783c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Acquiring lock "cinder-quobyte-4f6009c9-69e4-4909-8295-9ab82af8783c" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "cinder-quobyte-4f6009c9-69e4-4909-8295-9ab82af8783c" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f365dd4-b6f0-4d7b-bfde-eeb09d9aeaa9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:29 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c Jun 04 14:57:29 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:29 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7" returned: 0 in 0.625s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.631s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944991460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0203b084-7b48-4a19-99cc-fb612dbe0638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b42f1900e824e89b9109c7fa8b7acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:25Z,use_quota=True,user_id='76b7d28148e94534b7eea47f3c55395f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Creating volume 0203b084-7b48-4a19-99cc-fb612dbe0638 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:30 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:30 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 1073741824 Jun 04 14:57:30 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b509256-ab45-42ce-bdf1-295335c3b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35eaed51-0899-4f79-9d49-af44c7455ea7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b04ea4-1bb4-4bfd-86d2-fd6bc19dd8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:30 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume volume-35eaed51-0899-4f79-9d49-af44c7455ea7 (35eaed51-0899-4f79-9d49-af44c7455ea7): created successfully Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b04ea4-1bb4-4bfd-86d2-fd6bc19dd8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (878de65a-f917-4f00-812e-13df653d167e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:30 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0d746dbb-9620-4c96-8d0d-a26c77dcb009 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created volume successfully. Jun 04 14:57:30 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c" returned: 0 in 0.722s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:30 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c Jun 04 14:57:30 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:30 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 1073741824" returned: 0 in 0.778s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:30 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 Jun 04 14:57:30 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:31 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4f6009c9-69e4-4909-8295-9ab82af8783c" returned: 0 in 0.713s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "cinder-quobyte-4f6009c9-69e4-4909-8295-9ab82af8783c" released by "delete_volume" :: held 1.478s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Created reservations ['b800057a-07a9-43b2-af5d-33b674e5b883', 'da34cbbf-a991-4d3e-87d3-94622693e5dc', '49f350df-00ac-41d0-8f74-35f1fdce4740', '7abaf058-444f-43f2-b4c3-bbb2f69959aa'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:31 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:31 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:31 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.458s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-164004227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5308f0a2-2a8c-4733-925f-ad44e895e317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb1c86f7f0549c387fa105cd9b913b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:26Z,use_quota=True,user_id='0234cd109b874e3583ffbe286e27046c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Creating volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:31 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c449d2-5e0c-4d15-a5d3-e0ffcf94c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0203b084-7b48-4a19-99cc-fb612dbe0638', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a372808c-dd95-4176-bee8-e9e3037aac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:31 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 1073741824 Jun 04 14:57:31 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:31 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Volume volume-0203b084-7b48-4a19-99cc-fb612dbe0638 (0203b084-7b48-4a19-99cc-fb612dbe0638): created successfully Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a372808c-dd95-4176-bee8-e9e3037aac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Flow 'volume_create_manager' (429955f6-8832-4d73-a8ae-76c35394e344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-33b2225b-71cf-4bff-9bfb-27abbbc06cc5 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created volume successfully. Jun 04 14:57:31 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.596s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:32 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Deleted volume successfully. Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2dd68c29-5afb-40b8-b482-29e74d30d7ad tempest-TestServerVolumeAttachScenarioOldVersion-302047384 None] Lock "cinder-4f6009c9-69e4-4909-8295-9ab82af8783c-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-0203b084-7b48-4a19-99cc-fb612dbe0638-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-0203b084-7b48-4a19-99cc-fb612dbe0638-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-0203b084-7b48-4a19-99cc-fb612dbe0638" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-0203b084-7b48-4a19-99cc-fb612dbe0638" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:32 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 1073741824" returned: 0 in 0.932s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dbbe55-5b85-49a0-b2da-3b32523f1f75]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:32 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 Jun 04 14:57:32 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:32 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 Jun 04 14:57:32 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:33 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317" returned: 0 in 0.792s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.004s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-255160227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f910e37-0531-423f-8f43-3d40fe594748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ab243facc9419e9b95bc4a0044c477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:27Z,use_quota=True,user_id='0340f0caddc34b2498dbb161889acd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Creating volume 9f910e37-0531-423f-8f43-3d40fe594748 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:33 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:33 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 1073741824 Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c5a798-0608-4473-9683-2ee239ec2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5308f0a2-2a8c-4733-925f-ad44e895e317', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:33 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b86a3-c647-46cc-9f9b-e697c96d3c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:33 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638" returned: 0 in 0.947s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Volume volume-5308f0a2-2a8c-4733-925f-ad44e895e317 (5308f0a2-2a8c-4733-925f-ad44e895e317): created successfully Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b86a3-c647-46cc-9f9b-e697c96d3c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Flow 'volume_create_manager' (47e026f0-3ea3-4927-8ec5-25cf841523c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:33 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638 Jun 04 14:57:33 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:33 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f49dd86d-153c-4834-ac31-5966ed2adc9a tempest-SnapshotsActionsTest-1605112583 None] Created volume successfully. Jun 04 14:57:34 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0203b084-7b48-4a19-99cc-fb612dbe0638" returned: 0 in 0.739s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-0203b084-7b48-4a19-99cc-fb612dbe0638" released by "delete_volume" :: held 1.741s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['12bfd85d-a9c2-4f7a-ad06-7faf82162d0e', 'f0513aa6-39d9-45ad-ae96-d9407c485aa5', 'd2dfec77-e2d4-47a5-b6d0-27e43fb5f029', '41e81bd6-3484-4944-94e5-660a684632f0'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:34 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 1073741824" returned: 0 in 0.949s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:34 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:34 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:34 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 Jun 04 14:57:34 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-35eaed51-0899-4f79-9d49-af44c7455ea7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-35eaed51-0899-4f79-9d49-af44c7455ea7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-35eaed51-0899-4f79-9d49-af44c7455ea7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-35eaed51-0899-4f79-9d49-af44c7455ea7" acquired by "delete_volume" :: waited 0.040s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b67514-673c-4c4c-b0ca-17e5f339745d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:35 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748" returned: 0 in 0.779s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.103s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:35 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 Jun 04 14:57:35 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44317a7c-1d66-44a6-b521-c4877a7977e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f910e37-0531-423f-8f43-3d40fe594748', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0ae0a6-e129-43c6-9b46-df8bce130bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:35 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Creating offline snapshot 0e5ef57f-d483-46c4-ba67-1e2d2b70557b of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:57:35 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Volume volume-9f910e37-0531-423f-8f43-3d40fe594748 (9f910e37-0531-423f-8f43-3d40fe594748): created successfully Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0ae0a6-e129-43c6-9b46-df8bce130bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Flow 'volume_create_manager' (e6030934-23f7-41ac-b089-04cc8744868f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b2764-9b08-4c91-ab63-c82fb0d1d0a3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.931s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ec796ea9-eaf5-46d3-b03a-3736cc05811d tempest-VolumesMetadataTest-1261665816 None] Created volume successfully. Jun 04 14:57:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleted volume successfully. Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-05af85e4-659f-492b-b3c0-7b9f82c5a73b tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-0203b084-7b48-4a19-99cc-fb612dbe0638-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:35 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 Jun 04 14:57:35 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:35 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7" returned: 0 in 0.960s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:35 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7 Jun 04 14:57:35 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:36 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317" returned: 0 in 0.860s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:36 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b 1G Jun 04 14:57:36 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Acquiring lock "cinder-9f910e37-0531-423f-8f43-3d40fe594748-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Lock "cinder-9f910e37-0531-423f-8f43-3d40fe594748-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Acquiring lock "cinder-quobyte-9f910e37-0531-423f-8f43-3d40fe594748" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Lock "cinder-quobyte-9f910e37-0531-423f-8f43-3d40fe594748" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:36 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-35eaed51-0899-4f79-9d49-af44c7455ea7" returned: 0 in 0.754s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1c447-344c-4d9e-aaf3-f383b3659f19]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-35eaed51-0899-4f79-9d49-af44c7455ea7" released by "delete_volume" :: held 1.806s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['380a0c58-7b33-453e-8edc-e326cd50b640', 'bd6f019d-b471-4a7e-8742-251ddce44009', 'db1d0d56-a55e-43d3-b8a8-fa66cb9bb0f3', 'a6162f2e-f6cc-47ed-8b17-9a84eabf2fbc'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:36 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 Jun 04 14:57:36 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:36 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:36 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:37 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b 1G" returned: 0 in 0.940s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:37 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:57:37 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-95234710-9628-469a-84fa-0c6d788fc6c0-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-95234710-9628-469a-84fa-0c6d788fc6c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-95234710-9628-469a-84fa-0c6d788fc6c0" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-95234710-9628-469a-84fa-0c6d788fc6c0" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbcbe4-fdae-4e73-89d6-816fb7c1a529]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:37 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 Jun 04 14:57:37 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:37 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.736s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:37 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleted volume successfully. Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-53e0baa7-f06d-4143-b15f-8be1d509a9b7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-35eaed51-0899-4f79-9d49-af44c7455ea7-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:37 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748" returned: 0 in 1.035s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:37 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748 Jun 04 14:57:37 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:37 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.939s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:37 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b is being set with open permissions: ugo+rw Jun 04 14:57:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:37 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:57:37 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:38 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0" returned: 0 in 0.961s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:38 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0 Jun 04 14:57:38 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:38 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9f910e37-0531-423f-8f43-3d40fe594748" returned: 0 in 0.640s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Lock "cinder-quobyte-9f910e37-0531-423f-8f43-3d40fe594748" released by "delete_volume" :: held 1.725s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Created reservations ['a9e99524-9dc3-44a9-add5-a7858d085686', 'e9a1969e-fe0a-45f1-b706-58a6a54d3aa2', '80393580-48ac-484b-a505-b5434c534639', '4aff3850-71b8-49f8-928b-c86ba012153f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:38 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:38 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:38 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.647s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:38 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info Jun 04 14:57:38 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:38 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-95234710-9628-469a-84fa-0c6d788fc6c0" returned: 0 in 0.760s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-95234710-9628-469a-84fa-0c6d788fc6c0" released by "delete_volume" :: held 1.784s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['ff7700d2-d45c-43b3-99d4-346509d9a3c0', 'e77a3a21-01ab-44e1-802d-b0076c13006b', '3ded5be5-6142-4430-882d-3ca9c4742f92', '386b4fc2-78dd-474d-bf19-29c349e8d883'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:39 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:39 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:39 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.753s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:39 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Deleted volume successfully. Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1c77537-ed80-4451-8dc5-e03dd2cfc582 tempest-VolumesMetadataTest-1261665816 None] Lock "cinder-9f910e37-0531-423f-8f43-3d40fe594748-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-b64a437e-d834-48c5-b5a3-2e3d8552ec11-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-b64a437e-d834-48c5-b5a3-2e3d8552ec11-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:39 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info" returned: 0 in 0.933s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:39 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info is being set with open permissions: ugo+rw Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-b64a437e-d834-48c5-b5a3-2e3d8552ec11" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:39 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info Jun 04 14:57:39 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-b64a437e-d834-48c5-b5a3-2e3d8552ec11" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c4c09-a6c9-457e-9ff4-75ede1085f8f]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:39 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 Jun 04 14:57:39 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:39 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.860s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:39 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:39 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleted volume successfully. Jun 04 14:57:40 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-679a8d5e-352a-44d7-998b-41486a929a86 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-95234710-9628-469a-84fa-0c6d788fc6c0-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:40 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.info" returned: 0 in 0.741s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.217s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ac2d1c26-0331-463f-9622-160d20b4468e tempest-SnapshotsActionsTest-1605112583 None] Create snapshot completed successfully Jun 04 14:57:40 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11" returned: 0 in 0.974s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:40 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11 Jun 04 14:57:40 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:41 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b64a437e-d834-48c5-b5a3-2e3d8552ec11" returned: 0 in 0.653s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-b64a437e-d834-48c5-b5a3-2e3d8552ec11" released by "delete_volume" :: held 1.679s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['5471a9b1-b21a-4d09-a6f4-e285f028efed', 'a15b3c56-046d-4ef9-8031-f3ef2618e017', 'c79b2da3-e365-4851-b349-68df924cf282', '8df8eadc-c77a-4ae0-8398-bfe459617da8'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:41 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:41 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-f1420faf-2cb8-413d-9eaf-9045e3dc53b2-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-f1420faf-2cb8-413d-9eaf-9045e3dc53b2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-f1420faf-2cb8-413d-9eaf-9045e3dc53b2" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-f1420faf-2cb8-413d-9eaf-9045e3dc53b2" acquired by "delete_volume" :: waited 0.035s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d504130-6978-486d-a073-fc490b2e6068]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:42 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 Jun 04 14:57:42 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Creating offline snapshot 26d2bdb6-8cd7-488d-b681-061d4f6eac2c of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf1c422-f0ef-4d74-92f9-9aa512f73456]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:42 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.020s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleted volume successfully. Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6928603e-629a-4fa2-b4bd-93f5b09e5dbe tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-b64a437e-d834-48c5-b5a3-2e3d8552ec11-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:42 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:57:42 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Flow 'volume_create_manager' (cb56f909-3fb4-4876-b1bc-aac984d5f57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17481060-3220-44e6-8f9c-8f34375bbac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17481060-3220-44e6-8f9c-8f34375bbac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-160603104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f59856-fd55-4a4e-87ba-a6c43d4198b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791aff2808804a5dafe7441eb759a2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:43Z,use_quota=True,user_id='cb75c2fefaf94380972d26e384be0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0e7196-be03-4d71-8b45-763aa421899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0e7196-be03-4d71-8b45-763aa421899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8e43a5-2fd4-4bd6-97b3-ad2968fb6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8e43a5-2fd4-4bd6-97b3-ad2968fb6b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f59856-fd55-4a4e-87ba-a6c43d4198b5', 'volume_name': 'volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5', 'volume_size': 2}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fdf5d2-8394-42ca-967b-0e1a1d23bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fdf5d2-8394-42ca-967b-0e1a1d23bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f16a8da-6f3e-4353-9725-f9c0e6dec450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Volume c5f59856-fd55-4a4e-87ba-a6c43d4198b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5', 'volume_size': 2} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:42 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2" returned: 0 in 0.895s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:43 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2 Jun 04 14:57:43 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:43 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.828s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:43 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c 1G Jun 04 14:57:43 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:43 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f1420faf-2cb8-413d-9eaf-9045e3dc53b2" returned: 0 in 0.685s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-f1420faf-2cb8-413d-9eaf-9045e3dc53b2" released by "delete_volume" :: held 1.687s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['73559da3-04f9-4279-90d5-9eaabf7ebbb1', '1cf217be-9d03-4b39-a02b-b8c58a1170a2', 'ba5985ec-3b63-4bd8-805a-3dbe7bb31cbc', '912eeb12-6893-4ac5-9041-f28846800106'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:43 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:43 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-644d255c-346b-4780-b084-1e350a48f364-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-644d255c-346b-4780-b084-1e350a48f364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-f147e8a7-ce55-43ff-b602-8f7382781d71" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-f147e8a7-ce55-43ff-b602-8f7382781d71" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-644d255c-346b-4780-b084-1e350a48f364" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:44 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c 1G" returned: 0 in 0.942s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-644d255c-346b-4780-b084-1e350a48f364" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleting offline snapshot 644d255c-346b-4780-b084-1e350a48f364 of volume f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:57:44 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c Jun 04 14:57:44 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] snapshot_file for this snap is: volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e40cc7-ddf8-41ad-9563-93c3caac07c1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:44 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 Jun 04 14:57:44 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:44 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.844s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleted volume successfully. Jun 04 14:57:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2e83edd1-c68f-44a7-a18e-b60d28e5c3f3 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-f1420faf-2cb8-413d-9eaf-9045e3dc53b2-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:45 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c" returned: 0 in 0.908s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:45 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c is being set with open permissions: ugo+rw Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:45 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c Jun 04 14:57:45 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:45 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364" returned: 0 in 1.035s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f147e8a7-ce55-43ff-b602-8f7382781d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed49d1-7026-4869-a508-5a9fe609224b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:45 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 Jun 04 14:57:45 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:45 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c" returned: 0 in 0.674s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.508s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.130s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-160603104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f59856-fd55-4a4e-87ba-a6c43d4198b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791aff2808804a5dafe7441eb759a2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:43Z,use_quota=True,user_id='cb75c2fefaf94380972d26e384be0391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Creating volume c5f59856-fd55-4a4e-87ba-a6c43d4198b5 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:45 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 2147483648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:45 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 2147483648 Jun 04 14:57:45 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:45 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8c39b52b-ac71-4a5c-a8ff-8574bd3f6e04 tempest-SnapshotsActionsTest-1605112583 None] Create snapshot completed successfully Jun 04 14:57:46 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71" returned: 0 in 0.827s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:46 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 Jun 04 14:57:46 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-26d2bdb6-8cd7-488d-b681-061d4f6eac2c-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-26d2bdb6-8cd7-488d-b681-061d4f6eac2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-26d2bdb6-8cd7-488d-b681-061d4f6eac2c" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-26d2bdb6-8cd7-488d-b681-061d4f6eac2c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Deleting offline snapshot 26d2bdb6-8cd7-488d-b681-061d4f6eac2c of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] snapshot_file for this snap is: volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e86268-3581-48f4-bbca-c6aee9b9ab4c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:46 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 2147483648" returned: 0 in 1.032s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:46 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 Jun 04 14:57:46 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:47 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c Jun 04 14:57:47 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:47 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364" returned: 0 in 1.017s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:47 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364 Jun 04 14:57:47 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:47 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5" returned: 0 in 0.753s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f16a8da-6f3e-4353-9725-f9c0e6dec450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5', 'volume_size': 2}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6f9553-aaab-4abe-8b4d-e6320cbeea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:47 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c" returned: 0 in 0.927s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:47 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Volume volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 (c5f59856-fd55-4a4e-87ba-a6c43d4198b5): created successfully Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6f9553-aaab-4abe-8b4d-e6320cbeea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Flow 'volume_create_manager' (cb56f909-3fb4-4876-b1bc-aac984d5f57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fa386-7b45-4035-ba6b-017738498f29]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:47 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1a8a60df-a6f3-4763-bcd9-8b1d90c0a14c tempest-VolumesCloneNegativeTest-2061022709 None] Created volume successfully. Jun 04 14:57:47 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71.644d255c-346b-4780-b084-1e350a48f364" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:47 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:57:47 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-644d255c-346b-4780-b084-1e350a48f364" released by "_delete_snapshot" :: held 3.735s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-f147e8a7-ce55-43ff-b602-8f7382781d71" released by "delete_snapshot" :: held 3.776s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['80aab1ce-9ff5-4580-bfe9-a38cccc89f20', '523625fb-420d-4dd1-81d6-98779ac2edc2', '741c79c1-a98c-411e-93e8-e7261a5746b6', 'c7b399a8-7584-434d-81e2-40a4b9fff870'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Delete snapshot completed successfully. Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69f76855-ef31-4a93-97d3-7c1756de23a7 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-644d255c-346b-4780-b084-1e350a48f364-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Acquiring lock "cinder-c5f59856-fd55-4a4e-87ba-a6c43d4198b5-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Lock "cinder-c5f59856-fd55-4a4e-87ba-a6c43d4198b5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Acquiring lock "cinder-quobyte-c5f59856-fd55-4a4e-87ba-a6c43d4198b5" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Lock "cinder-quobyte-c5f59856-fd55-4a4e-87ba-a6c43d4198b5" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1c27e-6408-469c-bf66-c23489bdcf98]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-f147e8a7-ce55-43ff-b602-8f7382781d71-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-f147e8a7-ce55-43ff-b602-8f7382781d71-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "cinder-quobyte-f147e8a7-ce55-43ff-b602-8f7382781d71" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-f147e8a7-ce55-43ff-b602-8f7382781d71" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:48 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 Jun 04 14:57:48 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[55926989-2e86-4c03-ae61-5e7f95c9f953]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:48 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.962s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:48 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 Jun 04 14:57:48 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:48 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c Jun 04 14:57:48 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:49 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71" returned: 0 in 0.973s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:49 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5" returned: 0 in 1.207s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:49 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71 Jun 04 14:57:49 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:49 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5 Jun 04 14:57:49 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:49 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c" returned: 0 in 1.104s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:49 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c Jun 04 14:57:49 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:50 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-c5f59856-fd55-4a4e-87ba-a6c43d4198b5" returned: 0 in 0.761s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Lock "cinder-quobyte-c5f59856-fd55-4a4e-87ba-a6c43d4198b5" released by "delete_volume" :: held 2.059s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:50 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f147e8a7-ce55-43ff-b602-8f7382781d71" returned: 0 in 0.916s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Created reservations ['40d0bdf6-5ba4-4f1b-a82e-75b7c1a1cec6', 'bdce5bc9-1a70-47f6-a5b4-9eba5ffb7d7f', 'd1da5bf2-fde5-46fb-9ed3-397b1e9c003e', 'cd6ca7d8-62e5-4beb-b409-97c2c90c75bd'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-quobyte-f147e8a7-ce55-43ff-b602-8f7382781d71" released by "delete_volume" :: held 2.020s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:50 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.26d2bdb6-8cd7-488d-b681-061d4f6eac2c" returned: 0 in 0.861s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:50 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:50 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-26d2bdb6-8cd7-488d-b681-061d4f6eac2c" released by "_delete_snapshot" :: held 3.999s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Created reservations ['be99b0aa-7b2e-49cd-871c-97935ab3502f', '0da8abde-c4c1-47f2-8351-d4f4c142fa53', 'ed444242-f96d-4fc6-9ea0-b2b5bd8eb22f', '0e85c7df-4c85-4d92-9fc0-0e7f0f95a261'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" released by "delete_snapshot" :: held 4.031s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Created reservations ['74872404-c78e-4b36-92b5-2b8212c6750f', '4a027c1f-4fd2-436c-aee4-4a9bfa529dfc', '70812f78-b2ce-427b-9abe-877bdd30305b', 'ba33433b-ca31-4c1a-a9ce-0e82b2b8b167'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:50 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:57:50 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Delete snapshot completed successfully. Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-455f503c-8235-4358-808e-6c4464c3c78c tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-26d2bdb6-8cd7-488d-b681-061d4f6eac2c-delete_snapshot" released by "delete_snapshot" :: held 4.296s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Creating offline snapshot 4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[15baa641-1d09-469f-9c32-7caa591e8a9c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:51 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.854s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Deleted volume successfully. Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e4b4686-4ad9-4e69-8037-3d49bb1fc4a8 tempest-VolumesCloneNegativeTest-2061022709 None] Lock "cinder-c5f59856-fd55-4a4e-87ba-a6c43d4198b5-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:51 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.784s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:57:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Deleted volume successfully. Jun 04 14:57:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-94998323-ed65-4c62-ba07-7954f9ad93a8 tempest-CreateVolumesFromSnapshotTest-1989364914 None] Lock "cinder-f147e8a7-ce55-43ff-b602-8f7382781d71-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:51 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:57:51 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:52 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.912s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:52 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 1G Jun 04 14:57:52 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:53 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 1G" returned: 0 in 0.921s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:53 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 Jun 04 14:57:53 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:54 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" returned: 0 in 0.827s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:54 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 is being set with open permissions: ugo+rw Jun 04 14:57:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:54 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 Jun 04 14:57:54 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:54 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" returned: 0 in 0.622s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.414s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-63d0d590-d202-452d-b96d-898125ff05ee tempest-SnapshotsActionsTest-1605112583 None] Create snapshot completed successfully Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Flow 'volume_create_manager' (ea27cb88-54c3-446a-bcb9-c98449c425f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9dadde-7c01-44e9-a7e8-09e82a13ecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9dadde-7c01-44e9-a7e8-09e82a13ecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-492819959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ea4a9-f955-4a32-ab98-a256d755240a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea95734649e340c28a52090ba74ab736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:56Z,use_quota=True,user_id='b18e9c764ac54cb0adb2314987a1a304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78dba0ab-c5a5-4dd5-986f-a525cefc2875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78dba0ab-c5a5-4dd5-986f-a525cefc2875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c30ffb-c73c-4c4c-bbf1-bdb7be0f7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c30ffb-c73c-4c4c-bbf1-bdb7be0f7b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9ea4a9-f955-4a32-ab98-a256d755240a', 'volume_name': 'volume-be9ea4a9-f955-4a32-ab98-a256d755240a', 'volume_size': 2}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fc34fc-0523-438f-b68e-70eaef55ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fc34fc-0523-438f-b68e-70eaef55ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e370ba-2969-4ade-bd67-b86d5d86743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Volume be9ea4a9-f955-4a32-ab98-a256d755240a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9ea4a9-f955-4a32-ab98-a256d755240a', 'volume_size': 2} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-492819959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ea4a9-f955-4a32-ab98-a256d755240a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea95734649e340c28a52090ba74ab736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:56Z,use_quota=True,user_id='b18e9c764ac54cb0adb2314987a1a304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Creating volume be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:56 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a 2147483648 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:56 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a 2147483648 Jun 04 14:57:56 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (3cd00538-064e-41cb-85da-a2e587fb7706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834a4dc1-63df-4364-9d5b-8b24e2f6dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834a4dc1-63df-4364-9d5b-8b24e2f6dee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-983702600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cdae34-d03c-40ab-b9dd-18631a034abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:56Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cd5504-4a05-4626-aa7f-f0d65fce3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cd5504-4a05-4626-aa7f-f0d65fce3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64481d77-ef9e-4d07-a3b1-aaff8d2af463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64481d77-ef9e-4d07-a3b1-aaff8d2af463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cdae34-d03c-40ab-b9dd-18631a034abb', 'volume_name': 'volume-59cdae34-d03c-40ab-b9dd-18631a034abb', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6af099-63e3-4e60-a759-c4a503135c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6af099-63e3-4e60-a759-c4a503135c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c759ab77-971b-4b60-8ede-b21cf62814f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:56 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume 59cdae34-d03c-40ab-b9dd-18631a034abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cdae34-d03c-40ab-b9dd-18631a034abb', 'volume_size': 1} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Deleting offline snapshot 4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] snapshot_file for this snap is: volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1cd91-f582-49c2-a19c-9230849afa70]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:56 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 Jun 04 14:57:56 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:57 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a 2147483648" returned: 0 in 0.981s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:57 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc174966-9720-4798-ac7f-0855774e1b4c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:57 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a Jun 04 14:57:57 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:57 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:57:57 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Flow 'volume_create_manager' (b4679ffd-1135-4fad-93ef-669da7bc86a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22297bf8-88ab-49d7-8f9a-6431e1bc18ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22297bf8-88ab-49d7-8f9a-6431e1bc18ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d530cd-a7dd-4ac7-9744-0937cbb83ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d75deaa04e489a9cd4efb28c112cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:57Z,use_quota=True,user_id='b4dceba83fb547949c34cb87a6d4a931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4672bda-e035-4579-87c8-f677b969bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4672bda-e035-4579-87c8-f677b969bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836af7c6-141d-4580-8f71-c7646c2e6008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836af7c6-141d-4580-8f71-c7646c2e6008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06d530cd-a7dd-4ac7-9744-0937cbb83ad9', 'volume_name': 'volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9', 'volume_size': 1, 'image_id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f38f540acbbd35c3280b67e83f3951c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4d75deaa04e489a9cd4efb28c112cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b339417347a2056bbcbc6673462e84b1da970bc71e47ee8c4142492f964f414c331c4f9d6d884de35d99ae0153d256c62898697191e960fdd66bb83edd0962c0', 'id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'created_at': datetime.datetime(2026, 6, 4, 12, 57, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 57, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526/file', 'properties': {}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591cba93-5caf-4d3b-996a-b8f857b1b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591cba93-5caf-4d3b-996a-b8f857b1b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f726e7-04fd-4679-a594-722e10a92d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:57 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Volume 06d530cd-a7dd-4ac7-9744-0937cbb83ad9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9', 'volume_size': 1, 'image_id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f38f540acbbd35c3280b67e83f3951c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4d75deaa04e489a9cd4efb28c112cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b339417347a2056bbcbc6673462e84b1da970bc71e47ee8c4142492f964f414c331c4f9d6d884de35d99ae0153d256c62898697191e960fdd66bb83edd0962c0', 'id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'created_at': datetime.datetime(2026, 6, 4, 12, 57, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 57, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526/file', 'properties': {}}, 'image_service': } Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Trying to clone 06d530cd-a7dd-4ac7-9744-0937cbb83ad9 from image 9da1e908-d8c8-4df5-98f3-d2f7462e1526 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 14:57:57 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a" returned: 0 in 0.729s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 14:57:57 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Image download 0.00 MB at 0.00 MB/s Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-983702600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cdae34-d03c-40ab-b9dd-18631a034abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:56Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Creating volume 59cdae34-d03c-40ab-b9dd-18631a034abb {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:57:57 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:57:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:58 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb 1073741824 Jun 04 14:57:58 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e370ba-2969-4ade-bd67-b86d5d86743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9ea4a9-f955-4a32-ab98-a256d755240a', 'volume_size': 2}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:58 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc936fe-e485-4418-8c8d-a641b9983ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.815s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:58 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Volume volume-be9ea4a9-f955-4a32-ab98-a256d755240a (be9ea4a9-f955-4a32-ab98-a256d755240a): created successfully Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc936fe-e485-4418-8c8d-a641b9983ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:58 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 Jun 04 14:57:58 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Flow 'volume_create_manager' (ea27cb88-54c3-446a-bcb9-c98449c425f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5a0107-6982-40ce-8e64-a9b035e4c834]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1152a7cf-69d7-4a9b-b338-6a124c5b5282 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Created volume successfully. Jun 04 14:57:58 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD Jun 04 14:57:58 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:58 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" returned: 0 in 0.772s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:58 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4 Jun 04 14:57:58 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:58 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:58 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb 1073741824" returned: 0 in 0.911s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:58 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb Jun 04 14:57:58 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:58 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD Jun 04 14:57:58 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:57:59 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD" returned: 1 in 0.748s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Temporary image 9da1e908-d8c8-4df5-98f3-d2f7462e1526 is fetched for user b4dceba83fb547949c34cb87a6d4a931. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 14:57:59 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" returned: 0 in 0.800s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4" released by "_delete_snapshot" :: held 3.284s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" released by "delete_snapshot" :: held 3.347s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:59 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb" returned: 0 in 0.740s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.160s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c759ab77-971b-4b60-8ede-b21cf62814f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cdae34-d03c-40ab-b9dd-18631a034abb', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d723ff11-7712-4a96-ac7f-cfc6a6392bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d73181-e4a3-423e-9010-9d21bf8a0873]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:59 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume volume-59cdae34-d03c-40ab-b9dd-18631a034abb (59cdae34-d03c-40ab-b9dd-18631a034abb): created successfully Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d723ff11-7712-4a96-ac7f-cfc6a6392bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (3cd00538-064e-41cb-85da-a2e587fb7706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Creating offline snapshot aacdcf04-8c37-4d06-9cf7-c03611c38e3d of volume be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:57:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-17f909d7-3539-4f8e-b8b4-a8141fb632f2 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created volume successfully. Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d4930-ad59-4fa6-b236-72ae814eccea]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Created reservations ['048b9f3b-7ccb-49d9-bea2-1ebe91946f30', '72a45c92-589f-456d-a16a-cd75c3b9750d', 'cc3ddcc1-8dcd-480c-b6b0-eff7ac869087', '9299a7db-bd20-444d-9f74-640511469704'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:57:59 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD Jun 04 14:57:59 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:57:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Delete snapshot completed successfully. Jun 04 14:57:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e88b77ff-e4c1-4f08-85c2-d80a39a751d4 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-4a50c7f2-8cfe-4a26-bba0-e9478f2b41a4-delete_snapshot" released by "delete_snapshot" :: held 3.657s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:57:59 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a Jun 04 14:57:59 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:00 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:00 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a" returned: 0 in 0.775s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d 2G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:00 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD Jun 04 14:58:00 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:00 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d 2G Jun 04 14:58:00 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:01 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (0655b8ef-0374-49b4-a088-80d43805e48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d295a3db-75b7-40b3-b904-363b1bc1563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD" returned: 1 in 0.770s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d295a3db-75b7-40b3-b904-363b1bc1563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000658952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5576c0a3-84e4-444c-a128-f98d0bc70684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:01Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59968d0-77c7-4049-adfd-10751e8ad8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59968d0-77c7-4049-adfd-10751e8ad8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c2c8e4-69d9-4b6a-b7ea-fe6354b97f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c2c8e4-69d9-4b6a-b7ea-fe6354b97f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5576c0a3-84e4-444c-a128-f98d0bc70684', 'volume_name': 'volume-5576c0a3-84e4-444c-a128-f98d0bc70684', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e7f62e-c45a-47e4-bf4f-a994c8e959b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e7f62e-c45a-47e4-bf4f-a994c8e959b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a611b0-a784-45d1-9d9a-cfdc78aec488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume 5576c0a3-84e4-444c-a128-f98d0bc70684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5576c0a3-84e4-444c-a128-f98d0bc70684', 'volume_size': 1} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:01 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d 2G" returned: 0 in 0.877s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be9ea4a9-f955-4a32-ab98-a256d755240a -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:01 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be9ea4a9-f955-4a32-ab98-a256d755240a -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d Jun 04 14:58:01 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (00e5d24c-71b6-4ca9-ac10-937beb4c21f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a19b49-6d0a-4df2-bf09-f0ae19748c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a19b49-6d0a-4df2-bf09-f0ae19748c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958737829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b3e50f-0cdc-463d-9e37-ee71a507729e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:02Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69685bb-33dd-431c-9745-42743c8c6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69685bb-33dd-431c-9745-42743c8c6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de93678-302a-4258-8bf1-09b5569f4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de93678-302a-4258-8bf1-09b5569f4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b3e50f-0cdc-463d-9e37-ee71a507729e', 'volume_name': 'volume-66b3e50f-0cdc-463d-9e37-ee71a507729e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48fab23-7ff8-429b-9861-8e497df83c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48fab23-7ff8-429b-9861-8e497df83c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad94610-f242-49b8-a59a-4d8d24fc5699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume 66b3e50f-0cdc-463d-9e37-ee71a507729e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b3e50f-0cdc-463d-9e37-ee71a507729e', 'volume_size': 1} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (cc253a35-d04f-439c-8c0f-838d182af8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1268a8b1-c2ce-473c-8f9b-d1e95bd1a100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1268a8b1-c2ce-473c-8f9b-d1e95bd1a100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688122650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a8aecf-40f4-4173-a9bf-b044dae9b82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:02Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3afd7c-48ab-4dd1-a38c-e13852e99d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3afd7c-48ab-4dd1-a38c-e13852e99d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e1936-e748-4e52-985e-8f5088fdd17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e1936-e748-4e52-985e-8f5088fdd17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a8aecf-40f4-4173-a9bf-b044dae9b82b', 'volume_name': 'volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:01 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021b9975-6bd5-454d-97d8-a294f667609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021b9975-6bd5-454d-97d8-a294f667609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55586330-8f86-4e5c-a875-fcd95e7b57d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume f8a8aecf-40f4-4173-a9bf-b044dae9b82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b', 'volume_size': 1} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:02 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be9ea4a9-f955-4a32-ab98-a256d755240a -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d" returned: 0 in 0.685s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:02 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d is being set with open permissions: ugo+rw Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:02 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d Jun 04 14:58:02 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (26d4ba74-a706-4e17-9d45-f54f6bb8d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000c851f-fe4e-4412-888f-e182e648d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000c851f-fe4e-4412-888f-e182e648d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789826595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabbfc23-5155-46e1-85d2-600a6ca92dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:02Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db559353-71ef-4047-9b8d-cd2cccacef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db559353-71ef-4047-9b8d-cd2cccacef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8ec06-da14-4995-a9c5-30ee48e40f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8ec06-da14-4995-a9c5-30ee48e40f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabbfc23-5155-46e1-85d2-600a6ca92dfe', 'volume_name': 'volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae33925c-c1c5-4179-b67a-946fc134aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae33925c-c1c5-4179-b67a-946fc134aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b1cd8f-01d0-4a2a-a631-b9f7f68b70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume dabbfc23-5155-46e1-85d2-600a6ca92dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe', 'volume_size': 1} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (de7e5558-48dc-4837-80e0-e40b2e8789ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658cc4cc-ce38-438c-964a-9c2f181f000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658cc4cc-ce38-438c-964a-9c2f181f000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855693728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054080db-4945-4e7c-9788-4cab654f8629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:03Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46b15a2-400f-46ec-be25-2fd11994269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46b15a2-400f-46ec-be25-2fd11994269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbcdd66-6f29-40ca-ad1d-4520ed29861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbcdd66-6f29-40ca-ad1d-4520ed29861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054080db-4945-4e7c-9788-4cab654f8629', 'volume_name': 'volume-054080db-4945-4e7c-9788-4cab654f8629', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4024c8-889d-4424-97b1-85482fa1da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4024c8-889d-4424-97b1-85482fa1da0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71643214-6f7c-466b-b0b1-6a35d1d43798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:02 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume 054080db-4945-4e7c-9788-4cab654f8629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054080db-4945-4e7c-9788-4cab654f8629', 'volume_size': 1} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:02 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d" returned: 0 in 0.696s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:02 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info Jun 04 14:58:02 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:03 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info" returned: 0 in 0.608s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:03 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info is being set with open permissions: ugo+rw Jun 04 14:58:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:03 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info Jun 04 14:58:03 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:04 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.info" returned: 0 in 0.652s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.439s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.325s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Creating offline snapshot 00103fc7-469e-4ae9-81a0-0863c61f76d6 of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:58:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-855344e7-327d-469c-9077-0dd2f13e501c tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Create snapshot completed successfully Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ae17f-31d1-41b9-9d82-1025c7140abf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:04 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:04 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "cinder-aacdcf04-8c37-4d06-9cf7-c03611c38e3d-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-aacdcf04-8c37-4d06-9cf7-c03611c38e3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "cinder-quobyte-be9ea4a9-f955-4a32-ab98-a256d755240a" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-quobyte-be9ea4a9-f955-4a32-ab98-a256d755240a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "cinder-quobyte-aacdcf04-8c37-4d06-9cf7-c03611c38e3d" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-quobyte-aacdcf04-8c37-4d06-9cf7-c03611c38e3d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Deleting offline snapshot aacdcf04-8c37-4d06-9cf7-c03611c38e3d of volume be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] snapshot_file for this snap is: volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a16212-6197-4e3e-828d-ed595ad0e2bc]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:04 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.771s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:04 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 1G Jun 04 14:58:04 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:04 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d Jun 04 14:58:04 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:05 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d" returned: 0 in 0.776s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be9ea4a9-f955-4a32-ab98-a256d755240a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab3e747-9670-4a4f-ad62-928a59324f10]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:05 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 1G" returned: 0 in 0.803s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:05 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 Jun 04 14:58:05 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:05 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a Jun 04 14:58:05 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:06 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6" returned: 0 in 0.671s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:06 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 is being set with open permissions: ugo+rw Jun 04 14:58:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:06 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a" returned: 0 in 0.763s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:06 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 Jun 04 14:58:06 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:06 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d Jun 04 14:58:06 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:07 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6" returned: 0 in 0.594s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.851s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d530cd-a7dd-4ac7-9744-0937cbb83ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4d75deaa04e489a9cd4efb28c112cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:57:57Z,use_quota=True,user_id='b4dceba83fb547949c34cb87a6d4a931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Creating volume 06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:07 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:07 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 1073741824 Jun 04 14:58:07 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-efc5996c-fe8b-4514-939e-7f71c7d8323b tempest-SnapshotsActionsTest-1605112583 None] Create snapshot completed successfully Jun 04 14:58:07 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d" returned: 0 in 0.745s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:07 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d Jun 04 14:58:07 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:07 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a.aacdcf04-8c37-4d06-9cf7-c03611c38e3d" returned: 0 in 0.642s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-quobyte-aacdcf04-8c37-4d06-9cf7-c03611c38e3d" released by "_delete_snapshot" :: held 3.065s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-quobyte-be9ea4a9-f955-4a32-ab98-a256d755240a" released by "delete_snapshot" :: held 3.094s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:07 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 1073741824" returned: 0 in 0.835s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:07 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:07 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Created reservations ['8ac06028-80fd-4aae-b4a9-e3b648ff5987', 'a99c0762-8e5a-498d-9549-15c9e84ea9d6', 'b61e5297-4cc9-4ac1-a065-baab729ddb61', '2b852b03-2b17-411e-9fa8-7a712650d92f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:07 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:08 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Delete snapshot completed successfully. Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-afbd93e9-f4f9-4757-95cb-d092a5ecd011 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-aacdcf04-8c37-4d06-9cf7-c03611c38e3d-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-00103fc7-469e-4ae9-81a0-0863c61f76d6-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-00103fc7-469e-4ae9-81a0-0863c61f76d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-00103fc7-469e-4ae9-81a0-0863c61f76d6" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-00103fc7-469e-4ae9-81a0-0863c61f76d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Deleting offline snapshot 00103fc7-469e-4ae9-81a0-0863c61f76d6 of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] snapshot_file for this snap is: volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[db477918-4fea-4dda-b5e0-17bf9e838eae]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:08 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 Jun 04 14:58:08 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:08 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 0 in 0.641s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.326s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000658952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5576c0a3-84e4-444c-a128-f98d0bc70684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:01Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Creating volume 5576c0a3-84e4-444c-a128-f98d0bc70684 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:08 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=145,cinder:INSERT=42,cinder:UPDATE=168,cinder:DELETE=13 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:58:08 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 1073741824 Jun 04 14:58:08 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=131,cinder:INSERT=40,cinder:UPDATE=172,cinder:DELETE=15 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Attempting download of 9da1e908-d8c8-4df5-98f3-d2f7462e1526 ((None, [{'url': 'file:///opt/stack/data/glance/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'metadata': {}}])) to volume 06d530cd-a7dd-4ac7-9744-0937cbb83ad9. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aebe0b-0625-4914-8ed0-4cb94219ee0f]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:08 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu Jun 04 14:58:08 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "cinder-be9ea4a9-f955-4a32-ab98-a256d755240a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-be9ea4a9-f955-4a32-ab98-a256d755240a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "cinder-quobyte-be9ea4a9-f955-4a32-ab98-a256d755240a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:09 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6" returned: 0 in 0.907s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-quobyte-be9ea4a9-f955-4a32-ab98-a256d755240a" acquired by "delete_volume" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[812c9218-2556-4b2e-ad59-92cdc312c19c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5029126-00fa-4df4-ae41-a5b70d7d5e86]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:09 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a Jun 04 14:58:09 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:09 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:09 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:09 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 1073741824" returned: 0 in 0.908s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:09 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu" returned: 0 in 0.854s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:09 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 Jun 04 14:58:09 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:09 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu Jun 04 14:58:09 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:10 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.852s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:10 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 Jun 04 14:58:10 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:10 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a" returned: 0 in 0.909s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:10 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a Jun 04 14:58:10 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:10 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684" returned: 0 in 0.707s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.654s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958737829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b3e50f-0cdc-463d-9e37-ee71a507729e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:02Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Creating volume 66b3e50f-0cdc-463d-9e37-ee71a507729e {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:10 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a611b0-a784-45d1-9d9a-cfdc78aec488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5576c0a3-84e4-444c-a128-f98d0bc70684', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43344dc-fc9f-4b60-bc97-02cf2206a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:10 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e 1073741824 Jun 04 14:58:10 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume volume-5576c0a3-84e4-444c-a128-f98d0bc70684 (5576c0a3-84e4-444c-a128-f98d0bc70684): created successfully Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43344dc-fc9f-4b60-bc97-02cf2206a575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (0655b8ef-0374-49b4-a088-80d43805e48a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-29c6ce89-ac66-41cc-b5c8-a66abeda7822 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created volume successfully. Jun 04 14:58:10 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu" returned: 1 in 0.922s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9da1e908-d8c8-4df5-98f3-d2f7462e1526_1a1mi2gu' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b350d7-7e9f-40ab-890b-c2fdeba680fa]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:10 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD Jun 04 14:58:10 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:10 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6" returned: 0 in 0.797s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:10 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-be9ea4a9-f955-4a32-ab98-a256d755240a" returned: 0 in 0.741s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-quobyte-be9ea4a9-f955-4a32-ab98-a256d755240a" released by "delete_volume" :: held 1.733s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:10 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6 Jun 04 14:58:10 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:10 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Created reservations ['8b64f4a7-5c62-4fb8-b186-ebbbc87dc87c', '5d82c355-5390-4fd7-88c6-b04c46863a36', 'ca37e0da-08f4-448b-965c-6c57864fc9b2', '71e2f4b8-84b9-4a53-bccf-b14c718f7ad1'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:11 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:11 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:11 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e 1073741824" returned: 0 in 1.017s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:11 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:11 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e Jun 04 14:58:11 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:11 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD Jun 04 14:58:11 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:11 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.829s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:11 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.00103fc7-469e-4ae9-81a0-0863c61f76d6" returned: 0 in 1.018s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Deleted volume successfully. Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-00103fc7-469e-4ae9-81a0-0863c61f76d6" released by "_delete_snapshot" :: held 3.723s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" released by "delete_snapshot" :: held 3.752s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-aa2a0d4e-632e-4c42-8fab-13b00829b451 tempest-VolumesSnapshotNegativeTestJSON-1633564181 None] Lock "cinder-be9ea4a9-f955-4a32-ab98-a256d755240a-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Created reservations ['8ef5a3a2-ca09-4948-98f5-c392abce6866', 'af3c8fbd-2b69-4cc1-8dcd-8a6628236d63', 'aab84415-20f5-43cc-8a93-b5a40c8bf3dd', 'c1919b3a-f584-47cb-8a7b-68ce5187f097'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:12 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e" returned: 0 in 0.712s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.122s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688122650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a8aecf-40f4-4173-a9bf-b044dae9b82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:02Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Creating volume f8a8aecf-40f4-4173-a9bf-b044dae9b82b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:12 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:12 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b 1073741824 Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad94610-f242-49b8-a59a-4d8d24fc5699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b3e50f-0cdc-463d-9e37-ee71a507729e', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:12 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e33382-9991-4227-965a-4aefb5bb31c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Delete snapshot completed successfully. Jun 04 14:58:12 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume volume-66b3e50f-0cdc-463d-9e37-ee71a507729e (66b3e50f-0cdc-463d-9e37-ee71a507729e): created successfully Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e33382-9991-4227-965a-4aefb5bb31c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (00e5d24c-71b6-4ca9-ac10-937beb4c21f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2b92a302-44d6-4ff4-a3dc-b02bebf2f2a5 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-00103fc7-469e-4ae9-81a0-0863c61f76d6-delete_snapshot" released by "delete_snapshot" :: held 4.036s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fa427d4b-5b7a-40ff-ad0f-8be573677697 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created volume successfully. Jun 04 14:58:12 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD" returned: 1 in 1.014s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] 9da1e908-d8c8-4df5-98f3-d2f7462e1526 was raw, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:12 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:12 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:13 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b 1073741824" returned: 0 in 1.038s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:13 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 0 in 0.854s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9da1e908-d8c8-4df5-98f3-d2f7462e1526_rmo5w_mfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 14:58:13 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:13 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b Jun 04 14:58:13 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:13 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 1G Jun 04 14:58:13 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:13 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b" returned: 0 in 0.698s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.593s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789826595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabbfc23-5155-46e1-85d2-600a6ca92dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:02Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Creating volume dabbfc23-5155-46e1-85d2-600a6ca92dfe {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:13 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe 1073741824 Jun 04 14:58:13 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55586330-8f86-4e5c-a875-fcd95e7b57d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc4062f-c362-4c5e-9beb-06ea85a8af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:14 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b (f8a8aecf-40f4-4173-a9bf-b044dae9b82b): created successfully Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc4062f-c362-4c5e-9beb-06ea85a8af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (cc253a35-d04f-439c-8c0f-838d182af8e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:14 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 1G" returned: 0 in 0.779s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:14 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1c2af75d-97f7-4d75-afde-c57aeaab3d50 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created volume successfully. Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[71110f49-dd34-413b-8ea0-9ecb9c890831]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:14 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:14 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:14 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe 1073741824" returned: 0 in 0.904s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:14 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 0 in 0.788s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:14 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe Jun 04 14:58:14 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:14 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:14 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:15 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe" returned: 0 in 0.678s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.864s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855693728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054080db-4945-4e7c-9788-4cab654f8629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99edb53e934359ac877ab42ac51d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:03Z,use_quota=True,user_id='ebf56e86906846e6bdb3327aa9d62011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Creating volume 054080db-4945-4e7c-9788-4cab654f8629 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:15 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b1cd8f-01d0-4a2a-a631-b9f7f68b70a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab94a93a-eab1-4c63-bcb0-35ee1c924b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:15 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 1073741824 Jun 04 14:58:15 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe (dabbfc23-5155-46e1-85d2-600a6ca92dfe): created successfully Jun 04 14:58:15 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab94a93a-eab1-4c63-bcb0-35ee1c924b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (26d4ba74-a706-4e17-9d45-f54f6bb8d496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 1 in 0.825s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Downloaded image 9da1e908-d8c8-4df5-98f3-d2f7462e1526 ((None, [{'url': 'file:///opt/stack/data/glance/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'metadata': {}}])) to volume 06d530cd-a7dd-4ac7-9744-0937cbb83ad9 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Temporary image 9da1e908-d8c8-4df5-98f3-d2f7462e1526 for user b4dceba83fb547949c34cb87a6d4a931 is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Marking volume 06d530cd-a7dd-4ac7-9744-0937cbb83ad9 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 14:58:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7eeb172a-0983-421f-b2ec-f44685b38c02 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created volume successfully. Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Copying metadata from image 9da1e908-d8c8-4df5-98f3-d2f7462e1526 to 06d530cd-a7dd-4ac7-9744-0937cbb83ad9. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Creating volume glance metadata for volume 06d530cd-a7dd-4ac7-9744-0937cbb83ad9 backed by image 9da1e908-d8c8-4df5-98f3-d2f7462e1526 with: {'image_id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f38f540acbbd35c3280b67e83f3951c6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f726e7-04fd-4679-a594-722e10a92d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9', 'volume_size': 1, 'image_id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f38f540acbbd35c3280b67e83f3951c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4d75deaa04e489a9cd4efb28c112cff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b339417347a2056bbcbc6673462e84b1da970bc71e47ee8c4142492f964f414c331c4f9d6d884de35d99ae0153d256c62898697191e960fdd66bb83edd0962c0', 'id': '9da1e908-d8c8-4df5-98f3-d2f7462e1526', 'created_at': datetime.datetime(2026, 6, 4, 12, 57, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 12, 57, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9da1e908-d8c8-4df5-98f3-d2f7462e1526/file', 'properties': {}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f0c565-82ac-4357-9595-fe06f1b12dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Volume volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 (06d530cd-a7dd-4ac7-9744-0937cbb83ad9): created successfully Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f0c565-82ac-4357-9595-fe06f1b12dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Flow 'volume_create_manager' (b4679ffd-1135-4fad-93ef-669da7bc86a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f31c244a-fc82-48be-ab34-92a3075324a6 tempest-VolumeImageDependencyTests-11542290 None] Created volume successfully. Jun 04 14:58:16 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 1073741824" returned: 0 in 0.894s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:16 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 Jun 04 14:58:16 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Acquiring lock "cinder-06d530cd-a7dd-4ac7-9744-0937cbb83ad9-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Lock "cinder-06d530cd-a7dd-4ac7-9744-0937cbb83ad9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Acquiring lock "cinder-quobyte-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Lock "cinder-quobyte-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:17 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03671b1-0746-496d-9a05-1aae4e97f110]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629" returned: 0 in 0.691s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.356s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71643214-6f7c-466b-b0b1-6a35d1d43798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054080db-4945-4e7c-9788-4cab654f8629', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cc3550-4c2a-4e96-bac0-26996e52f957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Creating offline snapshot 227122cf-7294-4271-9bc9-98a075631a3e of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 14:58:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Volume volume-054080db-4945-4e7c-9788-4cab654f8629 (054080db-4945-4e7c-9788-4cab654f8629): created successfully Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cc3550-4c2a-4e96-bac0-26996e52f957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Flow 'volume_create_manager' (de7e5558-48dc-4837-80e0-e40b2e8789ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2a201-9299-4d11-a3a6-4959fa89c388]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:17 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:17 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-673c04be-82ce-456c-8fb4-820000bc4fc8 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created volume successfully. Jun 04 14:58:17 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:17 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:18 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 0 in 0.822s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-054080db-4945-4e7c-9788-4cab654f8629-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:18 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:18 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-054080db-4945-4e7c-9788-4cab654f8629-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-quobyte-054080db-4945-4e7c-9788-4cab654f8629" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:18 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.953s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-054080db-4945-4e7c-9788-4cab654f8629" acquired by "delete_volume" :: waited 0.043s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:18 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e 1G Jun 04 14:58:18 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16554c9-a504-4d7c-84be-3fd1b79530b9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:18 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 Jun 04 14:58:18 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:18 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 1 in 0.904s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 14:58:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:18 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9 Jun 04 14:58:18 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:19 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629" returned: 0 in 0.875s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:19 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629 Jun 04 14:58:19 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:19 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e 1G" returned: 0 in 0.977s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:19 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e Jun 04 14:58:19 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:19 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" returned: 0 in 0.950s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Lock "cinder-quobyte-06d530cd-a7dd-4ac7-9744-0937cbb83ad9" released by "delete_volume" :: held 2.765s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:19 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Created reservations ['c395f0c4-bb08-4bdc-9e77-feb017b42835', 'aa023da7-fdae-4d90-9fd8-edd9f55d188c', '28ab67ec-2da3-4b0a-8559-ebeccc197b83', 'f296b582-2575-4799-b6e3-8b6ea13ef93d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:20 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:20 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:20 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-054080db-4945-4e7c-9788-4cab654f8629" returned: 0 in 1.083s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-054080db-4945-4e7c-9788-4cab654f8629" released by "delete_volume" :: held 2.013s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created reservations ['713eaed0-e57f-40ca-b57c-5b2a0b337975', 'f89c237b-4f1f-4afe-b34d-10c82043d68a', '07d8e844-96c0-4cf7-a8d6-68e0de5318fe', 'd2df4d6a-1f67-465d-88b9-bff36ed9d296'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:20 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e" returned: 0 in 1.216s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:20 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e is being set with open permissions: ugo+rw Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:20 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e Jun 04 14:58:20 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:20 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:20 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:21 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.230s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Deleted volume successfully. Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-37f06642-ea9e-45c8-9f1e-c3d1a38bf799 tempest-VolumeImageDependencyTests-11542290 None] Lock "cinder-06d530cd-a7dd-4ac7-9744-0937cbb83ad9-delete_volume" released by "delete_volume" :: held 4.309s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:21 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.811s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Deleted volume successfully. Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-017b025e-e97d-44d2-bc60-5d6a1c6efa6a tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-054080db-4945-4e7c-9788-4cab654f8629-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:21 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e" returned: 0 in 1.150s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-dabbfc23-5155-46e1-85d2-600a6ca92dfe-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-dabbfc23-5155-46e1-85d2-600a6ca92dfe-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fb06d0c0-70b9-43d4-8681-25df2512b7b1 tempest-SnapshotsActionsTest-1605112583 None] Create snapshot completed successfully Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-quobyte-dabbfc23-5155-46e1-85d2-600a6ca92dfe" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-dabbfc23-5155-46e1-85d2-600a6ca92dfe" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8bc067-3566-42cc-8589-a36758938fa6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:22 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe Jun 04 14:58:22 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:22 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:22 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-227122cf-7294-4271-9bc9-98a075631a3e-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-227122cf-7294-4271-9bc9-98a075631a3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Acquiring lock "cinder-quobyte-227122cf-7294-4271-9bc9-98a075631a3e" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-227122cf-7294-4271-9bc9-98a075631a3e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Deleting offline snapshot 227122cf-7294-4271-9bc9-98a075631a3e of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] snapshot_file for this snap is: volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59be619-98a3-4742-9e1b-3b2800670fb7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:22 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:22 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e Jun 04 14:58:22 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe" returned: 0 in 0.975s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:22 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe Jun 04 14:58:22 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:23 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.289s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:23 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-dabbfc23-5155-46e1-85d2-600a6ca92dfe" returned: 0 in 0.866s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:23 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e" returned: 0 in 1.050s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-dabbfc23-5155-46e1-85d2-600a6ca92dfe" released by "delete_volume" :: held 1.909s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fbff4b-956d-47b7-b793-24cb472f150c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created reservations ['d8a95c7f-fcf9-4c03-888c-dbe35199a775', '0e67b5c9-4c8b-4d9c-9617-99dc8b5ebc79', '6f5b7e26-a44a-4c32-b569-78507585d9ef', '2debcc88-7904-4b93-a91d-c58759026561'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:23 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:23 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:23 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:23 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-f8a8aecf-40f4-4173-a9bf-b044dae9b82b-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-f8a8aecf-40f4-4173-a9bf-b044dae9b82b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-quobyte-f8a8aecf-40f4-4173-a9bf-b044dae9b82b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-f8a8aecf-40f4-4173-a9bf-b044dae9b82b" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b04377-d860-4177-b5d4-9c386fd5808a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:24 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b Jun 04 14:58:24 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:24 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.925s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Deleted volume successfully. Jun 04 14:58:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af586e4f-8a6a-4102-934f-35d4b849a730 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-dabbfc23-5155-46e1-85d2-600a6ca92dfe-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:25 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 1.280s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:25 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e Jun 04 14:58:25 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:25 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b" returned: 0 in 0.996s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:25 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b Jun 04 14:58:25 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:25 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e" returned: 0 in 0.884s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:26 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e Jun 04 14:58:26 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:26 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f8a8aecf-40f4-4173-a9bf-b044dae9b82b" returned: 0 in 0.612s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-f8a8aecf-40f4-4173-a9bf-b044dae9b82b" released by "delete_volume" :: held 1.718s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created reservations ['436a95e8-08b8-4500-8e0d-f6248bb2cf2b', 'a45152da-3bc4-40ae-95e9-6a58c0673aba', '4324bba4-1e73-4fa8-b027-353a50cb91a1', 'db069763-bf31-4b60-a897-8ac2a604ee96'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:26 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:26 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-66b3e50f-0cdc-463d-9e37-ee71a507729e-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-66b3e50f-0cdc-463d-9e37-ee71a507729e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:26 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-quobyte-66b3e50f-0cdc-463d-9e37-ee71a507729e" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.227122cf-7294-4271-9bc9-98a075631a3e" returned: 0 in 0.698s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-227122cf-7294-4271-9bc9-98a075631a3e" released by "_delete_snapshot" :: held 4.043s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-66b3e50f-0cdc-463d-9e37-ee71a507729e" acquired by "delete_volume" :: waited 0.050s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" released by "delete_snapshot" :: held 4.098s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[98276007-9d5c-425f-9df3-308a0e86bbce]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Created reservations ['6c84551c-471b-49c9-a21f-32a7cda6cc70', 'cdecfdae-a0c5-4678-85b2-c4b7fcdf5f93', '1fa7453b-eb73-4ad5-bef9-abcac2784984', '376c5a58-c71c-46b3-a76e-a792de54f03c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:26 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Delete snapshot completed successfully. Jun 04 14:58:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3287d265-6d0c-4499-a9b9-f9438fe1c312 tempest-SnapshotsActionsTest-1926821138 None] Lock "cinder-227122cf-7294-4271-9bc9-98a075631a3e-delete_snapshot" released by "delete_snapshot" :: held 4.317s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:26 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e Jun 04 14:58:26 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:27 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.800s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:27 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Deleted volume successfully. Jun 04 14:58:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-109db276-4d1d-46ec-bcb5-1d80f566ebd4 tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-f8a8aecf-40f4-4173-a9bf-b044dae9b82b-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:27 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e" returned: 0 in 0.878s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:27 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e Jun 04 14:58:27 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:28 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-66b3e50f-0cdc-463d-9e37-ee71a507729e" returned: 0 in 0.619s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-66b3e50f-0cdc-463d-9e37-ee71a507729e" released by "delete_volume" :: held 1.557s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created reservations ['cc309cfa-3bc4-48cb-b2ca-41a09c1e4106', '94aa5da9-d548-4b08-a766-acbbcc25feea', '358e264c-56a2-4e2a-9fd3-ac16d8937899', '4d45a2de-8b49-40d1-b63b-c1c2aa65dab7'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "cinder-0e5ef57f-d483-46c4-ba67-1e2d2b70557b-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-0e5ef57f-d483-46c4-ba67-1e2d2b70557b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "cinder-quobyte-0e5ef57f-d483-46c4-ba67-1e2d2b70557b" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-quobyte-0e5ef57f-d483-46c4-ba67-1e2d2b70557b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Deleting offline snapshot 0e5ef57f-d483-46c4-ba67-1e2d2b70557b of volume 5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] snapshot_file for this snap is: volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[967281e7-80ac-48c5-95aa-c3d2f10f8a3d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:28 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:28 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:28 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:28 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-5576c0a3-84e4-444c-a128-f98d0bc70684-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-5576c0a3-84e4-444c-a128-f98d0bc70684-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-quobyte-5576c0a3-84e4-444c-a128-f98d0bc70684" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-5576c0a3-84e4-444c-a128-f98d0bc70684" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c5ee4d-bf91-44c8-9544-2f09bb37cde7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:29 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 Jun 04 14:58:29 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:29 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.708s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Deleted volume successfully. Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-89e02f6f-7845-48ec-ac5f-21a585c1b1cb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-66b3e50f-0cdc-463d-9e37-ee71a507729e-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:29 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.881s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5308f0a2-2a8c-4733-925f-ad44e895e317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b1f668-f7bd-4018-ac87-789d672461cf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:29 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 Jun 04 14:58:29 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:29 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684" returned: 0 in 0.819s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:29 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684 Jun 04 14:58:29 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:30 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317" returned: 0 in 0.792s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:30 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:30 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:30 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5576c0a3-84e4-444c-a128-f98d0bc70684" returned: 0 in 0.613s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-5576c0a3-84e4-444c-a128-f98d0bc70684" released by "delete_volume" :: held 1.488s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created reservations ['141f1bf7-41de-42ea-a318-5a7bce2801d0', 'c42fcdd0-167e-4c7b-9bb1-1e6057e63636', 'caae4553-1075-4dfe-ab41-de95da6bc987', '24dd4083-697f-4744-a7bd-76eabc807ef9'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:30 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:30 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:31 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 0.883s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-59cdae34-d03c-40ab-b9dd-18631a034abb-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:31 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b Jun 04 14:58:31 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-59cdae34-d03c-40ab-b9dd-18631a034abb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "cinder-quobyte-59cdae34-d03c-40ab-b9dd-18631a034abb" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-59cdae34-d03c-40ab-b9dd-18631a034abb" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c3987-e48a-4fe5-9487-5f4a0bcd56a3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:31 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb Jun 04 14:58:31 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:31 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.961s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Deleted volume successfully. Jun 04 14:58:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91a005d3-a644-46a8-8fce-56e3ee6e183d tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-5576c0a3-84e4-444c-a128-f98d0bc70684-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:32 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317.0e5ef57f-d483-46c4-ba67-1e2d2b70557b" returned: 0 in 1.060s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:32 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb" returned: 0 in 0.850s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:32 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb Jun 04 14:58:32 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-quobyte-0e5ef57f-d483-46c4-ba67-1e2d2b70557b" released by "_delete_snapshot" :: held 3.795s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" released by "delete_snapshot" :: held 3.822s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Created reservations ['e5126eb9-838b-4da8-aac7-1f263821a329', '1fb72984-a132-405e-af9a-e7ae8971ad79', '79aa8092-16ec-4174-bd9d-de8b1f0311c2', 'a358ba84-a24d-41cf-ac50-cf6516c93115'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:32 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Delete snapshot completed successfully. Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1749dadb-abd2-4dc3-a360-702502844686 tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-0e5ef57f-d483-46c4-ba67-1e2d2b70557b-delete_snapshot" released by "delete_snapshot" :: held 3.997s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "cinder-5308f0a2-2a8c-4733-925f-ad44e895e317-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-5308f0a2-2a8c-4733-925f-ad44e895e317-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:32 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-59cdae34-d03c-40ab-b9dd-18631a034abb" returned: 0 in 0.723s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-quobyte-59cdae34-d03c-40ab-b9dd-18631a034abb" released by "delete_volume" :: held 1.633s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4330368b-f994-4f5d-a078-2389c0687516]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:32 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Created reservations ['61b88cb1-cf74-42b2-a679-2b301c9d0cf2', '135cafda-5f3e-4c07-9d99-2678ff44c8d5', '425dd2be-e6c7-41b6-98b7-7c72fcb18b09', 'fc93082e-526d-4cfe-b843-e2835d0e7d84'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:33 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 Jun 04 14:58:33 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:33 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:33 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:33 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.741s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:33 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Deleted volume successfully. Jun 04 14:58:33 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317" returned: 0 in 0.884s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f5e8596c-68b2-4c75-bcbc-0e6ed206efeb tempest-CreateVolumesFromSourceVolumeTest-710744366 None] Lock "cinder-59cdae34-d03c-40ab-b9dd-18631a034abb-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:33 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317 Jun 04 14:58:33 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:34 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5308f0a2-2a8c-4733-925f-ad44e895e317" returned: 0 in 0.740s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-quobyte-5308f0a2-2a8c-4733-925f-ad44e895e317" released by "delete_volume" :: held 1.717s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Created reservations ['6db71b56-95b6-4f8d-a7e0-5e0d85ca8a5d', '3f947908-6023-45dd-8274-f4e1a9817db0', '43c1120b-825d-419f-9076-64bd2288593e', 'e13d17f8-f333-48df-ae41-926bf7313f8c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:34 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:34 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:35 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.676s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:35 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Deleted volume successfully. Jun 04 14:58:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d5898163-c7a7-4387-a2e8-f319a824842b tempest-SnapshotsActionsTest-1605112583 None] Lock "cinder-5308f0a2-2a8c-4733-925f-ad44e895e317-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Flow 'volume_create_manager' (f31c1282-85f3-4afa-a920-2cd15da02239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f62461-e41e-4144-ae53-9f2752cec078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f62461-e41e-4144-ae53-9f2752cec078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-973670050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edc0022-1c25-4bea-9502-842c8f3cbf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8c72bdbc3e4ab99860d568389d59fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:39Z,use_quota=True,user_id='d4058240d54b4ccc9c837d0a246e5aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e28f08f-e30f-4b74-b1cb-2a92638a0153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e28f08f-e30f-4b74-b1cb-2a92638a0153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7e9911-a821-4bb3-8244-caca67d2d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7e9911-a821-4bb3-8244-caca67d2d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4edc0022-1c25-4bea-9502-842c8f3cbf76', 'volume_name': 'volume-4edc0022-1c25-4bea-9502-842c8f3cbf76', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc3280e-0392-4f7e-9134-08562be03a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc3280e-0392-4f7e-9134-08562be03a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a22aac-242f-4c79-b563-c8b34953bf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Volume 4edc0022-1c25-4bea-9502-842c8f3cbf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4edc0022-1c25-4bea-9502-842c8f3cbf76', 'volume_size': 1} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-973670050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edc0022-1c25-4bea-9502-842c8f3cbf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8c72bdbc3e4ab99860d568389d59fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:39Z,use_quota=True,user_id='d4058240d54b4ccc9c837d0a246e5aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Creating volume 4edc0022-1c25-4bea-9502-842c8f3cbf76 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:39 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:39 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 1073741824 Jun 04 14:58:39 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Flow 'volume_create_manager' (f08b5522-9048-4c76-a436-177654e1e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ca16b-671a-420d-9cca-fb34153573bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ca16b-671a-420d-9cca-fb34153573bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1104551012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1396b5a1-c02f-4df4-8c58-f0e6bc776d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8c72bdbc3e4ab99860d568389d59fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:39Z,use_quota=True,user_id='d4058240d54b4ccc9c837d0a246e5aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf611183-bfc2-418a-bfb2-a2c24557c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf611183-bfc2-418a-bfb2-a2c24557c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c66f65-b52f-4486-ba91-0aab1d870788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c66f65-b52f-4486-ba91-0aab1d870788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1396b5a1-c02f-4df4-8c58-f0e6bc776d5a', 'volume_name': 'volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704bf499-a14e-43ec-b709-e1852c794fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704bf499-a14e-43ec-b709-e1852c794fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bad7f67-a177-476c-89af-8457f8d0c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:39 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Volume 1396b5a1-c02f-4df4-8c58-f0e6bc776d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a', 'volume_size': 1} Jun 04 14:58:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:40 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 1073741824" returned: 0 in 1.064s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:40 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 Jun 04 14:58:40 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:41 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76" returned: 0 in 0.708s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1104551012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1396b5a1-c02f-4df4-8c58-f0e6bc776d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8c72bdbc3e4ab99860d568389d59fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:39Z,use_quota=True,user_id='d4058240d54b4ccc9c837d0a246e5aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Creating volume 1396b5a1-c02f-4df4-8c58-f0e6bc776d5a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:41 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a22aac-242f-4c79-b563-c8b34953bf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4edc0022-1c25-4bea-9502-842c8f3cbf76', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56700379-e92f-4ac5-a970-48b935580831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:41 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a 1073741824 Jun 04 14:58:41 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:41 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Volume volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 (4edc0022-1c25-4bea-9502-842c8f3cbf76): created successfully Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56700379-e92f-4ac5-a970-48b935580831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:41 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Flow 'volume_create_manager' (f31c1282-85f3-4afa-a920-2cd15da02239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3e835453-77f9-4ccc-80ef-b3faef494b49 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Created volume successfully. Jun 04 14:58:42 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a 1073741824" returned: 0 in 0.917s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:42 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a Jun 04 14:58:42 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:42 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" returned: 0 in 0.714s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bad7f67-a177-476c-89af-8457f8d0c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7288914-6852-4f77-98b6-e166906061ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Volume volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a (1396b5a1-c02f-4df4-8c58-f0e6bc776d5a): created successfully Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7288914-6852-4f77-98b6-e166906061ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Flow 'volume_create_manager' (f08b5522-9048-4c76-a436-177654e1e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-737add06-3a3b-49c8-a35f-a68a41bfb6dd tempest-TestServerVolumeAttachmentScenario-1922832386 None] Created volume successfully. Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Flow 'volume_create_manager' (53669f27-54ac-47fc-a91e-09195acf3544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453ececb-0f7a-4058-b193-e470292b1190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453ececb-0f7a-4058-b193-e470292b1190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1145173520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19b8943-3fe9-40a7-93e5-46cf7c4478d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ae6df88a014f22b6d93f74c31ac720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:47Z,use_quota=True,user_id='85868826213544fb961e543f5902a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f78cb5-41bd-43aa-8600-4f16ac84e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f78cb5-41bd-43aa-8600-4f16ac84e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8664123-a644-4bdd-9a62-24a5696812d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8664123-a644-4bdd-9a62-24a5696812d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19b8943-3fe9-40a7-93e5-46cf7c4478d7', 'volume_name': 'volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a667d5-4a22-4c0b-b972-2baf6e603c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a667d5-4a22-4c0b-b972-2baf6e603c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d116a5a3-8f14-4915-a5b1-4ce74bbdd6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:47 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Volume b19b8943-3fe9-40a7-93e5-46cf7c4478d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7', 'volume_size': 1} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1145173520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19b8943-3fe9-40a7-93e5-46cf7c4478d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ae6df88a014f22b6d93f74c31ac720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:47Z,use_quota=True,user_id='85868826213544fb961e543f5902a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Creating volume b19b8943-3fe9-40a7-93e5-46cf7c4478d7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:47 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:47 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 1073741824 Jun 04 14:58:47 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:48 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 1073741824" returned: 0 in 0.800s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:48 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 Jun 04 14:58:48 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:48 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7" returned: 0 in 0.708s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d116a5a3-8f14-4915-a5b1-4ce74bbdd6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9155fe-ed1f-45d3-9518-9d995fcb7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:48 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Volume volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 (b19b8943-3fe9-40a7-93e5-46cf7c4478d7): created successfully Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9155fe-ed1f-45d3-9518-9d995fcb7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Flow 'volume_create_manager' (53669f27-54ac-47fc-a91e-09195acf3544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-844ac6c5-d607-460c-b184-3f872e1c2681 tempest-VolumeQuotasAdminTestJSON-55618510 None] Created volume successfully. Jun 04 14:58:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "cinder-b19b8943-3fe9-40a7-93e5-46cf7c4478d7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "cinder-b19b8943-3fe9-40a7-93e5-46cf7c4478d7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "cinder-quobyte-b19b8943-3fe9-40a7-93e5-46cf7c4478d7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "cinder-quobyte-b19b8943-3fe9-40a7-93e5-46cf7c4478d7" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:49 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe44ac-c01e-413a-a277-27169ba8e50a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:49 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 Jun 04 14:58:49 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:50 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7" returned: 0 in 0.806s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:50 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7 Jun 04 14:58:50 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:51 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b19b8943-3fe9-40a7-93e5-46cf7c4478d7" returned: 0 in 0.619s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "cinder-quobyte-b19b8943-3fe9-40a7-93e5-46cf7c4478d7" released by "delete_volume" :: held 1.478s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Created reservations ['bf50e407-4428-4f62-939c-4072c549a58f', 'e6266b01-d11c-4cc7-b0e5-0a0ce4118313', '31e9e1e7-e3cc-47d4-bcd3-420a0254a36c', '0302f388-fa28-4fba-bde6-463e80dd9fe2'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:51 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:51 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:51 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.583s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Deleted volume successfully. Jun 04 14:58:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9832bec6-3a7b-4196-965e-d039a70035eb tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "cinder-b19b8943-3fe9-40a7-93e5-46cf7c4478d7-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Flow 'volume_create_manager' (888501a5-6bae-4494-897e-159fe467afcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdada9a3-afd4-498d-aa3f-db558a8b72dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdada9a3-afd4-498d-aa3f-db558a8b72dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1447231443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69e4646-a05b-411a-84ba-b26c14a9747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ae6df88a014f22b6d93f74c31ac720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:52Z,use_quota=True,user_id='85868826213544fb961e543f5902a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5a2423-b408-4165-adc1-4d9c93df4f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5a2423-b408-4165-adc1-4d9c93df4f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f0974c-a609-4de9-9978-6f3b3c61edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f0974c-a609-4de9-9978-6f3b3c61edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69e4646-a05b-411a-84ba-b26c14a9747a', 'volume_name': 'volume-a69e4646-a05b-411a-84ba-b26c14a9747a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fea464-9674-4fe9-ae0d-4d5260f0c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fea464-9674-4fe9-ae0d-4d5260f0c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86c1a06-77f3-48dd-ab09-fe3df4df8a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Volume a69e4646-a05b-411a-84ba-b26c14a9747a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69e4646-a05b-411a-84ba-b26c14a9747a', 'volume_size': 1} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1447231443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69e4646-a05b-411a-84ba-b26c14a9747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ae6df88a014f22b6d93f74c31ac720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:58:52Z,use_quota=True,user_id='85868826213544fb961e543f5902a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Creating volume a69e4646-a05b-411a-84ba-b26c14a9747a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:58:52 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:52 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a 1073741824 Jun 04 14:58:52 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:52 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a 1073741824" returned: 0 in 0.737s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:53 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a Jun 04 14:58:53 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:53 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a" returned: 0 in 0.608s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86c1a06-77f3-48dd-ab09-fe3df4df8a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69e4646-a05b-411a-84ba-b26c14a9747a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5b005f-3a45-47db-b541-095c59df239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:58:53 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Volume volume-a69e4646-a05b-411a-84ba-b26c14a9747a (a69e4646-a05b-411a-84ba-b26c14a9747a): created successfully Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5b005f-3a45-47db-b541-095c59df239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:58:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Flow 'volume_create_manager' (888501a5-6bae-4494-897e-159fe467afcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:58:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e79e5e6b-2544-40b9-8057-602d60376ce9 tempest-VolumeQuotasAdminTestJSON-55618510 None] Created volume successfully. Jun 04 14:58:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3b23e04f-5157-4057-b09e-f1c2c8017496 tempest-VolumeQuotasAdminTestJSON-1214152461 None] Transfer volume completed successfully. Jun 04 14:58:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Acquiring lock "cinder-a69e4646-a05b-411a-84ba-b26c14a9747a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Lock "cinder-a69e4646-a05b-411a-84ba-b26c14a9747a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Acquiring lock "cinder-quobyte-a69e4646-a05b-411a-84ba-b26c14a9747a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:58:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Lock "cinder-quobyte-a69e4646-a05b-411a-84ba-b26c14a9747a" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:58:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a027b5e-9527-4389-81b5-0c5ca3ae52ea]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:58:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:56 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a Jun 04 14:58:56 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:56 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a" returned: 0 in 0.792s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:56 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a Jun 04 14:58:56 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:57 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a69e4646-a05b-411a-84ba-b26c14a9747a" returned: 0 in 0.685s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Lock "cinder-quobyte-a69e4646-a05b-411a-84ba-b26c14a9747a" released by "delete_volume" :: held 1.520s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Created reservations ['85c82247-6174-40f1-8e0b-4e74816f2951', '861927f9-7f39-4ca6-81ad-2936860fef48', 'f15c470a-7560-4c3a-94eb-5e90696e53a8', 'a045fc09-05be-4ea1-bdf5-dbf4627cf3bf'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:58:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:58:57 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:58:57 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:58:58 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jun 04 14:58:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.635s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:58:58 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:58:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Deleted volume successfully. Jun 04 14:58:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e9fca1be-dc2c-4a7d-98f1-0e6f0c36d74b tempest-VolumeQuotasAdminTestJSON-1948310838 None] Lock "cinder-a69e4646-a05b-411a-84ba-b26c14a9747a-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Flow 'volume_create_manager' (1bfaa65a-8d71-4129-9380-ce1d08fb1ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ba5590-f63b-45ba-bd67-cc60d3e4e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ba5590-f63b-45ba-bd67-cc60d3e4e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1734334653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5045c4-b7b1-48f4-bac2-4c3425cd570a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58fa2bc2e594c449f0f266713b56d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:05Z,use_quota=True,user_id='ff8c8c88aab44ce8903e358c97e01684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddec0768-e028-4954-acd6-598d0100896f),volume_type_id=ddec0768-e028-4954-acd6-598d0100896f)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6de900-d8c4-4d4b-b363-2dc3d51f58d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6de900-d8c4-4d4b-b363-2dc3d51f58d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c359d6-4e06-4747-b6ce-e1a7ca4e7e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c359d6-4e06-4747-b6ce-e1a7ca4e7e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5045c4-b7b1-48f4-bac2-4c3425cd570a', 'volume_name': 'volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54bfd85-f6e0-4acb-9586-016d17ca18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54bfd85-f6e0-4acb-9586-016d17ca18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b7efb6-aae5-4a43-a010-38dde3e745f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Volume 2e5045c4-b7b1-48f4-bac2-4c3425cd570a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a', 'volume_size': 1} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1734334653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5045c4-b7b1-48f4-bac2-4c3425cd570a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58fa2bc2e594c449f0f266713b56d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:05Z,use_quota=True,user_id='ff8c8c88aab44ce8903e358c97e01684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddec0768-e028-4954-acd6-598d0100896f),volume_type_id=ddec0768-e028-4954-acd6-598d0100896f)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Creating volume 2e5045c4-b7b1-48f4-bac2-4c3425cd570a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:05 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:05 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a 1073741824 Jun 04 14:59:05 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:06 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a 1073741824" returned: 0 in 0.823s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:06 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a Jun 04 14:59:06 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:06 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a" returned: 0 in 0.595s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b7efb6-aae5-4a43-a010-38dde3e745f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a59953-a58f-4566-91c6-5facd51844fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:06 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Volume volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a (2e5045c4-b7b1-48f4-bac2-4c3425cd570a): created successfully Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a59953-a58f-4566-91c6-5facd51844fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Flow 'volume_create_manager' (1bfaa65a-8d71-4129-9380-ce1d08fb1ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:06 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1360d139-06c4-4253-865b-6b157c78535e tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Created volume successfully. Jun 04 14:59:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:07 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:07 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:08 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.649s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:08 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:08 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d0a8fe80-c5a3-473f-85d2-38bf415bcc94 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Retype volume completed successfully. Jun 04 14:59:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Acquiring lock "cinder-2e5045c4-b7b1-48f4-bac2-4c3425cd570a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "cinder-2e5045c4-b7b1-48f4-bac2-4c3425cd570a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=145,cinder:SELECT=95,cinder:INSERT=36,cinder:DELETE=16 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=104,cinder:UPDATE=135,cinder:INSERT=38,cinder:DELETE=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Acquiring lock "cinder-quobyte-2e5045c4-b7b1-48f4-bac2-4c3425cd570a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "cinder-quobyte-2e5045c4-b7b1-48f4-bac2-4c3425cd570a" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[574cc031-1d40-4125-a314-094607a56e41]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:09 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a Jun 04 14:59:09 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:09 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a" returned: 0 in 0.700s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:09 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a Jun 04 14:59:09 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:10 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-2e5045c4-b7b1-48f4-bac2-4c3425cd570a" returned: 0 in 0.606s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "cinder-quobyte-2e5045c4-b7b1-48f4-bac2-4c3425cd570a" released by "delete_volume" :: held 1.343s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:10 devstack cinder-volume[86522]: WARNING cinder.quota [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:59:10 devstack cinder-volume[86522]: WARNING cinder.quota [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Created reservations ['a44d511a-f758-48f4-9d8e-5c332de97c58', '37110229-5081-415f-b402-75cfcaae6bb0', '25c7ba62-7a9a-44be-9d83-149ea62e31e0', '565d2d0f-19e7-47d4-ab02-0e00542ee2b5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:10 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:10 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:11 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.606s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:11 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Deleted volume successfully. Jun 04 14:59:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4c2465a-ccd7-4c39-a0ff-09f6bf08e5e0 tempest-VolumeRetypeWithoutMigrationTest-1402572451 None] Lock "cinder-2e5045c4-b7b1-48f4-bac2-4c3425cd570a-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Flow 'volume_create_manager' (d3b8959d-1dca-4dfa-a438-aaadc84f87c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdeb067-8ff8-45b7-a643-5dfb149b85c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdeb067-8ff8-45b7-a643-5dfb149b85c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-936277305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315eb002-ee19-4882-a658-7f9f25f3c00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940222a49b0f476c9bc2987890480686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:16Z,use_quota=True,user_id='f7ce1e7d22d2483f911386efc24fb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb97019-c3af-4b30-8f4a-f9632895c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb97019-c3af-4b30-8f4a-f9632895c089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8aa99c-c8b8-4950-96a9-16947bbd520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8aa99c-c8b8-4950-96a9-16947bbd520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315eb002-ee19-4882-a658-7f9f25f3c00b', 'volume_name': 'volume-315eb002-ee19-4882-a658-7f9f25f3c00b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd40263-20a9-401e-804c-aa0155870c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd40263-20a9-401e-804c-aa0155870c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f738e18a-8387-454c-87c5-71b6ddb2f82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:16 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Volume 315eb002-ee19-4882-a658-7f9f25f3c00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315eb002-ee19-4882-a658-7f9f25f3c00b', 'volume_size': 1} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-936277305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315eb002-ee19-4882-a658-7f9f25f3c00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940222a49b0f476c9bc2987890480686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:16Z,use_quota=True,user_id='f7ce1e7d22d2483f911386efc24fb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Creating volume 315eb002-ee19-4882-a658-7f9f25f3c00b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:16 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:16 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b 1073741824 Jun 04 14:59:16 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:16 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b 1073741824" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:16 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b Jun 04 14:59:16 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:17 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b" returned: 0 in 0.589s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f738e18a-8387-454c-87c5-71b6ddb2f82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315eb002-ee19-4882-a658-7f9f25f3c00b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb8f66a-98e9-46b9-9694-b470a8325cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Volume volume-315eb002-ee19-4882-a658-7f9f25f3c00b (315eb002-ee19-4882-a658-7f9f25f3c00b): created successfully Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb8f66a-98e9-46b9-9694-b470a8325cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Flow 'volume_create_manager' (d3b8959d-1dca-4dfa-a438-aaadc84f87c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-30df729b-445b-47b6-a027-1db6b8f04d61 tempest-VolumesListAdminTestJSON-1603254500 None] Created volume successfully. Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Flow 'volume_create_manager' (839e6df4-af0f-44d8-9136-32f59f33757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1a0833-5f09-4e61-86cf-f276d57b1d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1a0833-5f09-4e61-86cf-f276d57b1d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-353200437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022f094b-8bb0-47bc-9de9-926b9865ffa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940222a49b0f476c9bc2987890480686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:18Z,use_quota=True,user_id='f7ce1e7d22d2483f911386efc24fb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cde8ad0-005b-42e0-b800-27742415715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cde8ad0-005b-42e0-b800-27742415715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b157c381-c722-4951-83a2-905eea9df1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b157c381-c722-4951-83a2-905eea9df1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022f094b-8bb0-47bc-9de9-926b9865ffa7', 'volume_name': 'volume-022f094b-8bb0-47bc-9de9-926b9865ffa7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2280b7e-cdaf-4206-8e47-064fe8b100ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2280b7e-cdaf-4206-8e47-064fe8b100ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967d5360-2644-47be-ab92-6f6be0da9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:18 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Volume 022f094b-8bb0-47bc-9de9-926b9865ffa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022f094b-8bb0-47bc-9de9-926b9865ffa7', 'volume_size': 1} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-353200437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022f094b-8bb0-47bc-9de9-926b9865ffa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940222a49b0f476c9bc2987890480686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:18Z,use_quota=True,user_id='f7ce1e7d22d2483f911386efc24fb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Creating volume 022f094b-8bb0-47bc-9de9-926b9865ffa7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:18 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:18 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 1073741824 Jun 04 14:59:18 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:19 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 1073741824" returned: 0 in 0.781s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:19 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 Jun 04 14:59:19 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:20 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7" returned: 0 in 0.600s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967d5360-2644-47be-ab92-6f6be0da9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022f094b-8bb0-47bc-9de9-926b9865ffa7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6251d39-278e-4d97-996b-f8e81c9707ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:20 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Volume volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 (022f094b-8bb0-47bc-9de9-926b9865ffa7): created successfully Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6251d39-278e-4d97-996b-f8e81c9707ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:20 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Flow 'volume_create_manager' (839e6df4-af0f-44d8-9136-32f59f33757e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:20 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f305bf23-3064-405b-8f63-ba4ff74021bf tempest-VolumesListAdminTestJSON-1603254500 None] Created volume successfully. Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Flow 'volume_create_manager' (4f995901-3b4f-4633-9e9e-8ba1c55a0410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527d71c0-e35d-41ba-b5e3-6d499d24fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527d71c0-e35d-41ba-b5e3-6d499d24fc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1699234013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e3a60c-20b5-4364-a8c1-e5f9b11339aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940222a49b0f476c9bc2987890480686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:21Z,use_quota=True,user_id='f7ce1e7d22d2483f911386efc24fb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b6b552-0e80-4fc9-837d-9667e5cfde38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b6b552-0e80-4fc9-837d-9667e5cfde38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a4ed3-8bf4-429b-b04c-40afcab1e53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a4ed3-8bf4-429b-b04c-40afcab1e53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e3a60c-20b5-4364-a8c1-e5f9b11339aa', 'volume_name': 'volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997d5086-9bc5-4ea9-b942-5ea37ab51860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997d5086-9bc5-4ea9-b942-5ea37ab51860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd1ab8a-fc08-4dc6-bb59-0bd2f619a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:21 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Volume 30e3a60c-20b5-4364-a8c1-e5f9b11339aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa', 'volume_size': 1} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1699234013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e3a60c-20b5-4364-a8c1-e5f9b11339aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940222a49b0f476c9bc2987890480686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:21Z,use_quota=True,user_id='f7ce1e7d22d2483f911386efc24fb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Creating volume 30e3a60c-20b5-4364-a8c1-e5f9b11339aa {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:21 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:21 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa 1073741824 Jun 04 14:59:21 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:21 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa 1073741824" returned: 0 in 0.789s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:22 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa Jun 04 14:59:22 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:22 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:22 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:22 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa" returned: 0 in 0.620s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd1ab8a-fc08-4dc6-bb59-0bd2f619a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7950228-a964-4ebb-b0a4-f051f9499bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:22 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Volume volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa (30e3a60c-20b5-4364-a8c1-e5f9b11339aa): created successfully Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7950228-a964-4ebb-b0a4-f051f9499bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Flow 'volume_create_manager' (4f995901-3b4f-4633-9e9e-8ba1c55a0410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3a4e106b-4689-4c9b-b336-559464e60f57 tempest-VolumesListAdminTestJSON-1603254500 None] Created volume successfully. Jun 04 14:59:22 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.602s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:22 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbef5006-5ab9-4282-a144-5e4c93d74871]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:23 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 Jun 04 14:59:23 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Flow 'volume_create_manager' (c0bd464b-c9c7-4d6e-a380-00faa08e4882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9704c5-fe58-4213-ab11-c41b076b8778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9704c5-fe58-4213-ab11-c41b076b8778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1f7240-967e-4112-81ab-cbbd28b22e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00023ef454964bcaaa1b4a1593cd7ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:24Z,use_quota=True,user_id='9b34de6a86604fd2bc9ddc2d8e85520d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43beb16-1502-4b2d-b182-821aa68f1ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43beb16-1502-4b2d-b182-821aa68f1ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c56e8d-8662-471a-adfb-fd3635f8e6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c56e8d-8662-471a-adfb-fd3635f8e6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b1f7240-967e-4112-81ab-cbbd28b22e94', 'volume_name': 'volume-8b1f7240-967e-4112-81ab-cbbd28b22e94', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb80c96f-9e24-4147-9c9d-4ddd74a5f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb80c96f-9e24-4147-9c9d-4ddd74a5f822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244d169d-97c6-485f-a276-ed8646492c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:23 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Volume 8b1f7240-967e-4112-81ab-cbbd28b22e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b1f7240-967e-4112-81ab-cbbd28b22e94', 'volume_size': 1} Jun 04 14:59:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:24 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76" returned: 0 in 0.756s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1f7240-967e-4112-81ab-cbbd28b22e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00023ef454964bcaaa1b4a1593cd7ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:24Z,use_quota=True,user_id='9b34de6a86604fd2bc9ddc2d8e85520d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Creating volume 8b1f7240-967e-4112-81ab-cbbd28b22e94 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:24 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:24 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 1073741824 Jun 04 14:59:24 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-4edc0022-1c25-4bea-9502-842c8f3cbf76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84e85e92-8acf-4ca0-aff1-db8c4911ca7b', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:59:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-c170f467-1928-4c3c-a177-0c1cd1e22799 req-e7b05bef-bbc3-4a98-85b8-9fac94462c77 tempest-TestServerVolumeAttachmentScenario-1922832386 None] attachment_update completed successfully. Jun 04 14:59:24 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 1073741824" returned: 0 in 0.804s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:25 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 Jun 04 14:59:25 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:25 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94" returned: 0 in 0.622s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244d169d-97c6-485f-a276-ed8646492c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1f7240-967e-4112-81ab-cbbd28b22e94', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33987aca-24c0-45dd-a10b-9eea1e45e659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:25 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Volume volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 (8b1f7240-967e-4112-81ab-cbbd28b22e94): created successfully Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33987aca-24c0-45dd-a10b-9eea1e45e659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Flow 'volume_create_manager' (c0bd464b-c9c7-4d6e-a380-00faa08e4882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:25 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0674817a-97bb-4fe8-a919-9ec58a2a15eb tempest-VolumesListAdminTestJSON-1989806961 None] Created volume successfully. Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Acquiring lock "cinder-8b1f7240-967e-4112-81ab-cbbd28b22e94-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Lock "cinder-8b1f7240-967e-4112-81ab-cbbd28b22e94-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Acquiring lock "cinder-quobyte-8b1f7240-967e-4112-81ab-cbbd28b22e94" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Lock "cinder-quobyte-8b1f7240-967e-4112-81ab-cbbd28b22e94" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723f6d0-9120-4848-8de0-21b220019076]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "cinder-30e3a60c-20b5-4364-a8c1-e5f9b11339aa-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-30e3a60c-20b5-4364-a8c1-e5f9b11339aa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "cinder-quobyte-30e3a60c-20b5-4364-a8c1-e5f9b11339aa" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-quobyte-30e3a60c-20b5-4364-a8c1-e5f9b11339aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:26 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 Jun 04 14:59:26 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5dc095-f6a2-4e98-902c-f8c6b406fb29]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:26 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa Jun 04 14:59:26 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:26 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94" returned: 0 in 0.741s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:26 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94 Jun 04 14:59:26 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:26 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa" returned: 0 in 0.759s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:27 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa Jun 04 14:59:27 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:27 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8b1f7240-967e-4112-81ab-cbbd28b22e94" returned: 0 in 0.643s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Lock "cinder-quobyte-8b1f7240-967e-4112-81ab-cbbd28b22e94" released by "delete_volume" :: held 1.436s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Created reservations ['d49ae938-116e-41c8-935e-c36b9401b9f9', '86ff00ed-9e3f-4e09-a683-bfe9979023e7', 'a577e94e-d184-4c50-9a64-66af6268ccab', '864504cb-fec9-4fa6-a887-9c7a6d6519a7'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:27 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:27 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:27 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-30e3a60c-20b5-4364-a8c1-e5f9b11339aa" returned: 0 in 0.692s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-quobyte-30e3a60c-20b5-4364-a8c1-e5f9b11339aa" released by "delete_volume" :: held 1.504s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Created reservations ['71218a8d-ad47-410f-869f-3156d8c10c9a', '26ead69c-313a-481b-be2a-d4e5a35d1996', '19f142c4-ea7e-4025-b7f5-f8863b3eaa5f', '33ac3fe7-0394-4d94-9048-2a2019466ea3'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:27 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:27 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:28 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Deleted volume successfully. Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-202dd5d1-7cd1-4ec2-b3e6-de6feb847a20 tempest-VolumesListAdminTestJSON-1989806961 None] Lock "cinder-8b1f7240-967e-4112-81ab-cbbd28b22e94-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "cinder-022f094b-8bb0-47bc-9de9-926b9865ffa7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-022f094b-8bb0-47bc-9de9-926b9865ffa7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:28 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.654s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Deleted volume successfully. Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7d87cac5-86dd-4de3-b8a5-89b0a4db8c63 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-30e3a60c-20b5-4364-a8c1-e5f9b11339aa-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "cinder-quobyte-022f094b-8bb0-47bc-9de9-926b9865ffa7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-quobyte-022f094b-8bb0-47bc-9de9-926b9865ffa7" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8067a54-6de7-4c05-b83e-255f580930b6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:28 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 Jun 04 14:59:28 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:29 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7" returned: 0 in 0.759s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:29 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7 Jun 04 14:59:29 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:29 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-022f094b-8bb0-47bc-9de9-926b9865ffa7" returned: 0 in 0.604s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-quobyte-022f094b-8bb0-47bc-9de9-926b9865ffa7" released by "delete_volume" :: held 1.413s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Created reservations ['3febc2da-4bf3-42a3-9e3d-69de510b1525', '3c882aeb-73b0-4936-93b2-18b3dca48b16', '0bbd3786-662d-4d75-9341-b78801a1cfc2', 'd33a6864-a4bc-44b0-ab55-364af119d79f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:30 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:30 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:30 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.604s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:30 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Deleted volume successfully. Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-78ea99ca-96a1-4b98-8e96-8ae9b0efe39c tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-022f094b-8bb0-47bc-9de9-926b9865ffa7-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "cinder-315eb002-ee19-4882-a658-7f9f25f3c00b-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-315eb002-ee19-4882-a658-7f9f25f3c00b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "cinder-quobyte-315eb002-ee19-4882-a658-7f9f25f3c00b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-quobyte-315eb002-ee19-4882-a658-7f9f25f3c00b" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf503b-cd4d-4e13-8960-9245158de45c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:30 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b Jun 04 14:59:30 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:31 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b" returned: 0 in 0.723s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:31 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b Jun 04 14:59:31 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:32 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-315eb002-ee19-4882-a658-7f9f25f3c00b" returned: 0 in 0.589s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-quobyte-315eb002-ee19-4882-a658-7f9f25f3c00b" released by "delete_volume" :: held 1.355s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Created reservations ['64ad4287-1017-42a9-bff5-2387adce76b0', '9092419d-177f-4431-825a-25609d93e700', 'd3bed8f6-80da-4570-b3d5-f10a6e4cad4a', '3e909f27-542b-41e5-91a0-763becde1f24'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:32 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:32 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:32 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.672s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:32 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:32 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Deleted volume successfully. Jun 04 14:59:33 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d0f5263c-e029-44c5-b569-98969848fb64 tempest-VolumesListAdminTestJSON-1603254500 None] Lock "cinder-315eb002-ee19-4882-a658-7f9f25f3c00b-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:33 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae3a11-9f3c-45bc-bbca-f27b51340266]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:34 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a Jun 04 14:59:34 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:34 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" returned: 0 in 0.771s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b35668ed-5434-4263-8402-7c40eb98bdae', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 14:59:34 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-f45bfd06-b2d0-4d05-9681-22a8ba896996 req-d2d6f9ce-4344-4ff5-a9b3-a41584aa4dbe tempest-TestServerVolumeAttachmentScenario-1922832386 None] attachment_update completed successfully. Jun 04 14:59:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-9c703831-6492-46bc-8573-9dc9a6028767 req-8c98e313-c966-468d-b9c3-e5fba4056a5d tempest-TestServerVolumeAttachmentScenario-1922832386 None] Terminate volume connection completed successfully. Jun 04 14:59:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-9c703831-6492-46bc-8573-9dc9a6028767 req-8c98e313-c966-468d-b9c3-e5fba4056a5d tempest-TestServerVolumeAttachmentScenario-1922832386 None] Deleting attachment b35668ed-5434-4263-8402-7c40eb98bdae. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Flow 'volume_create_manager' (1c975422-69a3-4303-aac2-7943503aea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a1e2b0-9255-4129-abec-7fd6e5d27fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a1e2b0-9255-4129-abec-7fd6e5d27fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1659726141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7be226a-6c03-42b4-822e-acf71014998d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0fcf1488134838972c88dd04b47a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:42Z,use_quota=True,user_id='284fe8ed118a412b8773194ea22d8fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e924ac7-9f47-4b27-8536-360c356e2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e924ac7-9f47-4b27-8536-360c356e2207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d205a8-bb64-49f0-ad0d-176964cee4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d205a8-bb64-49f0-ad0d-176964cee4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7be226a-6c03-42b4-822e-acf71014998d', 'volume_name': 'volume-b7be226a-6c03-42b4-822e-acf71014998d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1c4cb4-ab6a-41bf-86cf-3b6f447028e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1c4cb4-ab6a-41bf-86cf-3b6f447028e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381cf4fc-9639-4b2f-bea5-3f662b0f0215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Volume b7be226a-6c03-42b4-822e-acf71014998d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7be226a-6c03-42b4-822e-acf71014998d', 'volume_size': 1} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1659726141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7be226a-6c03-42b4-822e-acf71014998d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0fcf1488134838972c88dd04b47a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:42Z,use_quota=True,user_id='284fe8ed118a412b8773194ea22d8fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Creating volume b7be226a-6c03-42b4-822e-acf71014998d {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:42 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:42 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d 1073741824 Jun 04 14:59:42 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:42 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d 1073741824" returned: 0 in 0.833s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:43 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d Jun 04 14:59:43 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:43 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d" returned: 0 in 0.587s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381cf4fc-9639-4b2f-bea5-3f662b0f0215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7be226a-6c03-42b4-822e-acf71014998d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd54bbfb-5b06-42ec-902e-2e5db72525a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:43 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Volume volume-b7be226a-6c03-42b4-822e-acf71014998d (b7be226a-6c03-42b4-822e-acf71014998d): created successfully Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd54bbfb-5b06-42ec-902e-2e5db72525a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Flow 'volume_create_manager' (1c975422-69a3-4303-aac2-7943503aea80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:43 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0eb1c5db-b6c3-4342-8737-f16e3b30031d tempest-AbsoluteLimitsTests-57158746 None] Created volume successfully. Jun 04 14:59:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-495230b5-4a8c-4f41-a651-12675ef1e0a8 req-1febb644-a35b-4c21-9154-5cb1f2a91773 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Terminate volume connection completed successfully. Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-495230b5-4a8c-4f41-a651-12675ef1e0a8 req-1febb644-a35b-4c21-9154-5cb1f2a91773 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Deleting attachment 84e85e92-8acf-4ca0-aff1-db8c4911ca7b. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Acquiring lock "cinder-b7be226a-6c03-42b4-822e-acf71014998d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Lock "cinder-b7be226a-6c03-42b4-822e-acf71014998d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Acquiring lock "cinder-quobyte-b7be226a-6c03-42b4-822e-acf71014998d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Lock "cinder-quobyte-b7be226a-6c03-42b4-822e-acf71014998d" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3963bdb-65a9-428d-8369-5ac2f5e42643]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:44 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d Jun 04 14:59:44 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:45 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d" returned: 0 in 0.724s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:45 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d Jun 04 14:59:45 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:45 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b7be226a-6c03-42b4-822e-acf71014998d" returned: 0 in 0.585s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Lock "cinder-quobyte-b7be226a-6c03-42b4-822e-acf71014998d" released by "delete_volume" :: held 1.349s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Created reservations ['47cab13c-943e-4210-ac1e-535b628c7b47', 'de043767-4d2d-4b1c-be0b-cc8611b98d33', 'ccdefb52-3edc-49aa-a024-f4b213446c3a', '5df38ac5-7b6c-4af1-8bfe-8a37fb88e9ee'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:45 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:45 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:46 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.596s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:46 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Deleted volume successfully. Jun 04 14:59:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-fff81418-6daa-430b-8fc5-1885c204ae70 tempest-AbsoluteLimitsTests-57158746 None] Lock "cinder-b7be226a-6c03-42b4-822e-acf71014998d-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Flow 'volume_create_manager' (3c824d91-fe0a-4bae-9ca9-ac4ae5ccbfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfe2a1b-f683-4d83-a5b3-c4a8ed95787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfe2a1b-f683-4d83-a5b3-c4a8ed95787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-25606508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81626e2-ed4e-48fd-9029-41616c4d9732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e836d85a9034ba5a55e7c5a636ab819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:52Z,use_quota=True,user_id='bd207357da044606a2cfcd882da6f37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2b73bc-0c9b-42b1-ad22-172623fb597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2b73bc-0c9b-42b1-ad22-172623fb597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a964149e-3bab-4147-a5b8-750377db4b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a964149e-3bab-4147-a5b8-750377db4b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81626e2-ed4e-48fd-9029-41616c4d9732', 'volume_name': 'volume-f81626e2-ed4e-48fd-9029-41616c4d9732', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da90abb2-550f-4f3d-b15a-30063967274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da90abb2-550f-4f3d-b15a-30063967274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41f8c26-647f-4277-b509-c87ccbd0cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Volume f81626e2-ed4e-48fd-9029-41616c4d9732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81626e2-ed4e-48fd-9029-41616c4d9732', 'volume_size': 1} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-25606508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81626e2-ed4e-48fd-9029-41616c4d9732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e836d85a9034ba5a55e7c5a636ab819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:52Z,use_quota=True,user_id='bd207357da044606a2cfcd882da6f37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Creating volume f81626e2-ed4e-48fd-9029-41616c4d9732 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:52 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:52 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 1073741824 Jun 04 14:59:52 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:53 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 1073741824" returned: 0 in 0.793s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:53 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 Jun 04 14:59:53 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:53 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732" returned: 0 in 0.649s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41f8c26-647f-4277-b509-c87ccbd0cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81626e2-ed4e-48fd-9029-41616c4d9732', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebceb2c-35aa-4733-aed0-bc979b6ee48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:53 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Volume volume-f81626e2-ed4e-48fd-9029-41616c4d9732 (f81626e2-ed4e-48fd-9029-41616c4d9732): created successfully Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebceb2c-35aa-4733-aed0-bc979b6ee48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Flow 'volume_create_manager' (3c824d91-fe0a-4bae-9ca9-ac4ae5ccbfd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c038a546-343d-41fa-856c-b92936cd648c tempest-VolumesTransfersV357Test-1385691395 None] Created volume successfully. Jun 04 14:59:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "cinder-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "cinder-quobyte-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-quobyte-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc0b5a9-47f4-4c6b-9c98-5e69be802547]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:55 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-dc6ec279-70d0-41fb-b4f8-b657c907ea5e tempest-VolumesTransfersV357Test-937221812 None] Transfer volume completed successfully. Jun 04 14:59:55 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a Jun 04 14:59:55 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:55 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" returned: 0 in 0.737s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:55 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a Jun 04 14:59:55 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Acquiring lock "cinder-f81626e2-ed4e-48fd-9029-41616c4d9732-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-f81626e2-ed4e-48fd-9029-41616c4d9732-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:55 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Acquiring lock "cinder-quobyte-f81626e2-ed4e-48fd-9029-41616c4d9732" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-quobyte-f81626e2-ed4e-48fd-9029-41616c4d9732" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f28b89-9eb9-4860-8a8a-52b2c24e05c3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:56 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 Jun 04 14:59:56 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:56 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" returned: 0 in 0.601s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-quobyte-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a" released by "delete_volume" :: held 1.382s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Created reservations ['3091cfe4-498a-4b41-98fe-d3cbef33256c', 'f4648fd2-d7a1-4ce6-b448-17c7c1b8eeac', '49b8164e-1e88-4cdf-95c8-29bda61fb140', '8f2729ab-76ab-4c0c-ae4d-a863219e15db'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:56 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:56 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:56 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732" returned: 0 in 0.717s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:56 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732 Jun 04 14:59:56 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:57 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.620s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Deleted volume successfully. Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8326d465-231d-4a1e-aa20-5c7a919a5a10 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-1396b5a1-c02f-4df4-8c58-f0e6bc776d5a-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "cinder-4edc0022-1c25-4bea-9502-842c8f3cbf76-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-4edc0022-1c25-4bea-9502-842c8f3cbf76-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "cinder-quobyte-4edc0022-1c25-4bea-9502-842c8f3cbf76" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-quobyte-4edc0022-1c25-4bea-9502-842c8f3cbf76" acquired by "delete_volume" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3797e6e7-4f9d-4415-888e-7bd154cb7ce2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:57 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 Jun 04 14:59:57 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:57 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-f81626e2-ed4e-48fd-9029-41616c4d9732" returned: 0 in 0.622s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-quobyte-f81626e2-ed4e-48fd-9029-41616c4d9732" released by "delete_volume" :: held 1.395s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Created reservations ['dbf2e341-ee77-4c4c-960e-4a95005d1f51', '6f7f9daf-87a8-44f9-8568-49d81c06cd60', 'a6cb88c4-c2fe-4a03-858b-b9230ac4a255', '45e687bb-eace-4172-a0bf-2e636413d55c'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:57 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:57 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:57 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76" returned: 0 in 0.732s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:58 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76 Jun 04 14:59:58 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:58 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.643s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Deleted volume successfully. Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5219aaec-7e67-4749-ac03-0edea7952fe7 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-f81626e2-ed4e-48fd-9029-41616c4d9732-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Flow 'volume_create_manager' (65d41342-8f8c-4c91-ac65-325ad679206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 14:59:58 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5f1e02-14c9-4580-8b87-ff5585bc7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-4edc0022-1c25-4bea-9502-842c8f3cbf76" returned: 0 in 0.666s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5f1e02-14c9-4580-8b87-ff5585bc7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1668575413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a729fcbd-530d-487d-8c0d-2c52e8ff296a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e836d85a9034ba5a55e7c5a636ab819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:59Z,use_quota=True,user_id='bd207357da044606a2cfcd882da6f37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ddce29-c4c0-4b98-8d97-ef9ef10ff008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ddce29-c4c0-4b98-8d97-ef9ef10ff008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e950ff35-ba42-484c-a2d0-7e7137848156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e950ff35-ba42-484c-a2d0-7e7137848156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a729fcbd-530d-487d-8c0d-2c52e8ff296a', 'volume_name': 'volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5495f990-a158-4cf1-93df-878dd8ebb13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5495f990-a158-4cf1-93df-878dd8ebb13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b3f2fd-8c2c-4600-88d6-771d43f4d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 14:59:58 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Volume a729fcbd-530d-487d-8c0d-2c52e8ff296a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a', 'volume_size': 1} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T12:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1668575413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a729fcbd-530d-487d-8c0d-2c52e8ff296a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e836d85a9034ba5a55e7c5a636ab819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T12:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T12:59:59Z,use_quota=True,user_id='bd207357da044606a2cfcd882da6f37c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Creating volume a729fcbd-530d-487d-8c0d-2c52e8ff296a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 14:59:58 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-quobyte-4edc0022-1c25-4bea-9502-842c8f3cbf76" released by "delete_volume" :: held 1.505s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:58 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a 1073741824 Jun 04 14:59:58 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Created reservations ['43683932-f86c-4986-a36e-7a501a3ffe5a', 'bb06cbf2-481a-4ad2-9fe9-3441a11b1a86', '64d91ded-8ad6-4e33-9bc0-b16f01594c13', 'fe6f886f-3aad-4c57-b6f3-a50c33908455'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 14:59:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:58 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 14:59:58 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 14:59:59 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.608s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:59 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 14:59:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Deleted volume successfully. Jun 04 14:59:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-63d0987c-29ee-479c-8178-2fcf48d0b1f1 tempest-TestServerVolumeAttachmentScenario-1922832386 None] Lock "cinder-4edc0022-1c25-4bea-9502-842c8f3cbf76-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 14:59:59 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jun 04 14:59:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a 1073741824" returned: 0 in 0.811s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 14:59:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 14:59:59 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a Jun 04 14:59:59 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:00 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a" returned: 0 in 0.630s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b3f2fd-8c2c-4600-88d6-771d43f4d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b520bf-ad21-4e89-9e2a-45e71ea22d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Volume volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a (a729fcbd-530d-487d-8c0d-2c52e8ff296a): created successfully Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b520bf-ad21-4e89-9e2a-45e71ea22d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Flow 'volume_create_manager' (65d41342-8f8c-4c91-ac65-325ad679206d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b32438e0-e9eb-4afd-95c5-eea5fffa2bdd tempest-VolumesTransfersV357Test-1385691395 None] Created volume successfully. Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Acquiring lock "cinder-a729fcbd-530d-487d-8c0d-2c52e8ff296a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-a729fcbd-530d-487d-8c0d-2c52e8ff296a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Acquiring lock "cinder-quobyte-a729fcbd-530d-487d-8c0d-2c52e8ff296a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-quobyte-a729fcbd-530d-487d-8c0d-2c52e8ff296a" acquired by "delete_volume" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[042714e1-c462-4509-bf28-350825890a3d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:01 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a Jun 04 15:00:01 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:01 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a" returned: 0 in 0.773s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:01 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a Jun 04 15:00:01 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:02 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a729fcbd-530d-487d-8c0d-2c52e8ff296a" returned: 0 in 0.622s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-quobyte-a729fcbd-530d-487d-8c0d-2c52e8ff296a" released by "delete_volume" :: held 1.446s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Created reservations ['1e85eb81-78b8-410f-a178-75147fc9d16a', 'e7995eb4-3972-44fb-9cee-9befda6afa4f', 'e31c1152-3109-4a4c-8a8a-4acf602283bd', 'ad1410ac-b226-49c1-b00d-f4981e8d1b5f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:02 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:02 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:03 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.613s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:03 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:03 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Deleted volume successfully. Jun 04 15:00:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-74e9b3c7-3e6e-40c2-98cb-09aca14a1905 tempest-VolumesTransfersV357Test-1806761183 None] Lock "cinder-a729fcbd-530d-487d-8c0d-2c52e8ff296a-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=101,cinder:DELETE=9 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=80,cinder:INSERT=22,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (aceeb0b5-0c7b-4e1e-a552-9c376ed4a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f07a5d-9038-42ce-8147-8de2de9ca128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Flow 'volume_create_manager' (400d1161-688e-4765-9dfa-e628d25b4599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d96caa-80cb-4a5e-919c-dccc08e73be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f07a5d-9038-42ce-8147-8de2de9ca128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603455772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8148b297-99fb-4b82-b56d-509e09250ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:10Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762e482-1774-42eb-8f84-e5b5d2948637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762e482-1774-42eb-8f84-e5b5d2948637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5887446c-0596-4e45-8789-42d74a29a245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5887446c-0596-4e45-8789-42d74a29a245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8148b297-99fb-4b82-b56d-509e09250ca4', 'volume_name': 'volume-8148b297-99fb-4b82-b56d-509e09250ca4', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e3f02-2215-46cd-9add-040cde8b27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e3f02-2215-46cd-9add-040cde8b27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ebcedb-a583-4a25-816d-1ab9ee170bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Volume 8148b297-99fb-4b82-b56d-509e09250ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8148b297-99fb-4b82-b56d-509e09250ca4', 'volume_size': 1} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603455772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8148b297-99fb-4b82-b56d-509e09250ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:10Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Creating volume 8148b297-99fb-4b82-b56d-509e09250ca4 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:10 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d96caa-80cb-4a5e-919c-dccc08e73be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1711034589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a193334d-5903-4c7c-88b3-fc2230fb74f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4a2f0a3914435daece6be9da2aff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:10Z,use_quota=True,user_id='0df4804e59e0413f8325cdd4d9abec9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb2f9d3-0ebf-4891-83e9-6e2e205a4773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 1073741824 Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb2f9d3-0ebf-4891-83e9-6e2e205a4773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa84bf7e-7704-40b8-8787-fa8ab885da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa84bf7e-7704-40b8-8787-fa8ab885da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a193334d-5903-4c7c-88b3-fc2230fb74f7', 'volume_name': 'volume-a193334d-5903-4c7c-88b3-fc2230fb74f7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb374c5-f2d5-4a19-89bd-987a06d63490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb374c5-f2d5-4a19-89bd-987a06d63490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdadcf6-ce4f-4a47-8838-673c0f1b2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Volume a193334d-5903-4c7c-88b3-fc2230fb74f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a193334d-5903-4c7c-88b3-fc2230fb74f7', 'volume_size': 1} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (25f9c88f-3576-41e0-830d-2ec7fbc34cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f638eb-f386-4fc6-b36f-ce535c8d1471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f638eb-f386-4fc6-b36f-ce535c8d1471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139078162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db93319-992c-472a-bece-9dbf0d739e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:10Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef79e26-4a65-4b62-a122-ac46127395a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef79e26-4a65-4b62-a122-ac46127395a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39786fd4-7d14-4704-a409-3c309a812e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39786fd4-7d14-4704-a409-3c309a812e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db93319-992c-472a-bece-9dbf0d739e20', 'volume_name': 'volume-8db93319-992c-472a-bece-9dbf0d739e20', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88542be7-c473-4115-9796-08b1943a1c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88542be7-c473-4115-9796-08b1943a1c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1704e832-3df3-4359-b1da-780ec3de902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Volume 8db93319-992c-472a-bece-9dbf0d739e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db93319-992c-472a-bece-9dbf0d739e20', 'volume_size': 1} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (f682bd16-4cc6-480b-a713-f75848847c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eed87f4-ca85-4a6f-bec1-751b02c2c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eed87f4-ca85-4a6f-bec1-751b02c2c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767796776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243f9f17-0ce7-4968-9837-e91f96fc8965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:11Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192ed1f6-7782-4027-8197-e57cda73b2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192ed1f6-7782-4027-8197-e57cda73b2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d33a09-b19b-4f87-a600-096f96e89bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d33a09-b19b-4f87-a600-096f96e89bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243f9f17-0ce7-4968-9837-e91f96fc8965', 'volume_name': 'volume-243f9f17-0ce7-4968-9837-e91f96fc8965', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914d403b-1322-449c-aeb4-eefdeae47a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914d403b-1322-449c-aeb4-eefdeae47a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5858e4-19fb-4113-b5cf-c45a7520e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Volume 243f9f17-0ce7-4968-9837-e91f96fc8965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243f9f17-0ce7-4968-9837-e91f96fc8965', 'volume_size': 1} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:10 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (8a49a71b-2549-4631-ab1a-654daec14f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:11 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aaf273-569f-4330-b560-2374b3e20bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 1073741824" returned: 0 in 0.849s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aaf273-569f-4330-b560-2374b3e20bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550555229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435e0951-36ff-4270-b9f3-ed3b7c21d3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:11Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6feff8c4-a34e-417c-bb1c-0b69bfd749fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6feff8c4-a34e-417c-bb1c-0b69bfd749fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19b555-4b76-4752-9b91-bb7fb98363c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19b555-4b76-4752-9b91-bb7fb98363c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435e0951-36ff-4270-b9f3-ed3b7c21d3c7', 'volume_name': 'volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f92f9d-1f5e-47dc-a235-bdc026360ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f92f9d-1f5e-47dc-a235-bdc026360ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3174f2-c946-44d0-a258-8484d13dcb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Volume 435e0951-36ff-4270-b9f3-ed3b7c21d3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7', 'volume_size': 1} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:11 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 Jun 04 15:00:11 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (3534814c-3b55-41b2-a704-c04e628878ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2e5d77-7b38-457d-93d7-37a854bf16a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2e5d77-7b38-457d-93d7-37a854bf16a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384506615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47dfede-4e38-4b2a-aac1-3eadf11c5264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:11Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c8d5ef-a18b-4695-acd5-699068418e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c8d5ef-a18b-4695-acd5-699068418e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c294670-524b-4631-bec7-924726e363c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c294670-524b-4631-bec7-924726e363c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47dfede-4e38-4b2a-aac1-3eadf11c5264', 'volume_name': 'volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c6883f-c7d2-48b8-8a62-8bef59b84bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c6883f-c7d2-48b8-8a62-8bef59b84bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2188c3ab-0c8e-436f-ad7f-83adc9a37985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Volume e47dfede-4e38-4b2a-aac1-3eadf11c5264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264', 'volume_size': 1} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:11 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4" returned: 0 in 0.636s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1711034589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a193334d-5903-4c7c-88b3-fc2230fb74f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4a2f0a3914435daece6be9da2aff2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:10Z,use_quota=True,user_id='0df4804e59e0413f8325cdd4d9abec9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Creating volume a193334d-5903-4c7c-88b3-fc2230fb74f7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:11 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:11 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 1073741824 Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ebcedb-a583-4a25-816d-1ab9ee170bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8148b297-99fb-4b82-b56d-509e09250ca4', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff8c2c-8a60-44c1-9427-8d47ffbf94a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:11 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Volume volume-8148b297-99fb-4b82-b56d-509e09250ca4 (8148b297-99fb-4b82-b56d-509e09250ca4): created successfully Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ff8c2c-8a60-44c1-9427-8d47ffbf94a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (aceeb0b5-0c7b-4e1e-a552-9c376ed4a25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d5ceb44a-b45c-43e7-96b8-5a37e36f330f tempest-CreateVolumesFromImageTest-55397983 None] Created volume successfully. Jun 04 15:00:12 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 1073741824" returned: 0 in 0.775s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:12 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 Jun 04 15:00:12 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:13 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7" returned: 0 in 0.599s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.816s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139078162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db93319-992c-472a-bece-9dbf0d739e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:10Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Creating volume 8db93319-992c-472a-bece-9dbf0d739e20 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdadcf6-ce4f-4a47-8838-673c0f1b2289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a193334d-5903-4c7c-88b3-fc2230fb74f7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44da9ea3-3853-4dfa-a64b-63b3314f29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:13 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 1073741824 Jun 04 15:00:13 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:13 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Volume volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 (a193334d-5903-4c7c-88b3-fc2230fb74f7): created successfully Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44da9ea3-3853-4dfa-a64b-63b3314f29e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Flow 'volume_create_manager' (400d1161-688e-4765-9dfa-e628d25b4599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ab6badd2-c6ce-4508-ae8d-109ff5408e5f tempest-VolumesNegativeTest-1066610817 None] Created volume successfully. Jun 04 15:00:13 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 1073741824" returned: 0 in 0.749s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:13 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 Jun 04 15:00:13 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:14 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20" returned: 0 in 0.602s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.815s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767796776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243f9f17-0ce7-4968-9837-e91f96fc8965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:11Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Creating volume 243f9f17-0ce7-4968-9837-e91f96fc8965 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:14 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:14 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 1073741824 Jun 04 15:00:14 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1704e832-3df3-4359-b1da-780ec3de902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db93319-992c-472a-bece-9dbf0d739e20', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513b2b25-e32d-48f1-997d-9a4b69ba1f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:14 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Volume volume-8db93319-992c-472a-bece-9dbf0d739e20 (8db93319-992c-472a-bece-9dbf0d739e20): created successfully Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513b2b25-e32d-48f1-997d-9a4b69ba1f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:14 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (25f9c88f-3576-41e0-830d-2ec7fbc34cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:14 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-803fa1c8-093b-4891-a964-f4a299bfce21 tempest-CreateVolumesFromImageTest-55397983 None] Created volume successfully. Jun 04 15:00:15 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 1073741824" returned: 0 in 0.774s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:15 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 Jun 04 15:00:15 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:16 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965" returned: 0 in 0.649s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.946s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550555229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435e0951-36ff-4270-b9f3-ed3b7c21d3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:11Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Creating volume 435e0951-36ff-4270-b9f3-ed3b7c21d3c7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:16 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5858e4-19fb-4113-b5cf-c45a7520e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243f9f17-0ce7-4968-9837-e91f96fc8965', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:16 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 1073741824 Jun 04 15:00:16 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5120cf-c99c-4584-a1bf-4bfe067da5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:16 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Volume volume-243f9f17-0ce7-4968-9837-e91f96fc8965 (243f9f17-0ce7-4968-9837-e91f96fc8965): created successfully Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5120cf-c99c-4584-a1bf-4bfe067da5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (f682bd16-4cc6-480b-a713-f75848847c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3f8f9424-1042-47a2-91f2-c2d242c6df8f tempest-CreateVolumesFromImageTest-55397983 None] Created volume successfully. Jun 04 15:00:16 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 1073741824" returned: 0 in 0.819s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:16 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 Jun 04 15:00:16 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:17 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7" returned: 0 in 0.646s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.114s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384506615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47dfede-4e38-4b2a-aac1-3eadf11c5264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3665d145b18e4e2caddc7ac679244ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:11Z,use_quota=True,user_id='79a574394080463e8446474f8c2ef099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Creating volume e47dfede-4e38-4b2a-aac1-3eadf11c5264 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:17 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3174f2-c946-44d0-a258-8484d13dcb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa1c7d9-e202-4d86-9117-4b94674c1ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:17 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 1073741824 Jun 04 15:00:17 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Volume volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 (435e0951-36ff-4270-b9f3-ed3b7c21d3c7): created successfully Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa1c7d9-e202-4d86-9117-4b94674c1ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (8a49a71b-2549-4631-ab1a-654daec14f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-bb7a6924-ad90-4ae7-9bbe-b7d77d5fc01d tempest-CreateVolumesFromImageTest-55397983 None] Created volume successfully. Jun 04 15:00:18 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 1073741824" returned: 0 in 0.876s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:18 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 Jun 04 15:00:18 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:19 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264" returned: 0 in 0.617s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2188c3ab-0c8e-436f-ad7f-83adc9a37985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ce3b1a-2ef1-4c61-83d6-9b19f35e3e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:19 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Volume volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 (e47dfede-4e38-4b2a-aac1-3eadf11c5264): created successfully Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ce3b1a-2ef1-4c61-83d6-9b19f35e3e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:19 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Flow 'volume_create_manager' (3534814c-3b55-41b2-a704-c04e628878ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-00f24b70-9dc7-4839-aa01-b71d777588d8 tempest-CreateVolumesFromImageTest-55397983 None] Created volume successfully. Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-e47dfede-4e38-4b2a-aac1-3eadf11c5264-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-e47dfede-4e38-4b2a-aac1-3eadf11c5264-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-quobyte-e47dfede-4e38-4b2a-aac1-3eadf11c5264" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-e47dfede-4e38-4b2a-aac1-3eadf11c5264" acquired by "delete_volume" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cfa9e5-11b2-4447-867b-8819a3886cd0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:20 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 Jun 04 15:00:20 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:20 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264" returned: 0 in 0.817s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:21 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264 Jun 04 15:00:21 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:21 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e47dfede-4e38-4b2a-aac1-3eadf11c5264" returned: 0 in 0.694s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-e47dfede-4e38-4b2a-aac1-3eadf11c5264" released by "delete_volume" :: held 1.569s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Created reservations ['212f5dda-ec5c-4bb5-9067-79bfc5a4a3c7', '5a3ebf4e-3513-45e0-b1d5-92ac6f0ae179', '15b1408e-d096-48bf-b601-7ade302afc2d', '0c7e03dc-2c5b-4eb6-b4d8-eb3c3e54bedd'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:21 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:21 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:22 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:22 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:22 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.633s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Deleted volume successfully. Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-435e0951-36ff-4270-b9f3-ed3b7c21d3c7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3acc617e-6743-4c7a-a240-4a2ece1b127e tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-e47dfede-4e38-4b2a-aac1-3eadf11c5264-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-435e0951-36ff-4270-b9f3-ed3b7c21d3c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-quobyte-435e0951-36ff-4270-b9f3-ed3b7c21d3c7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-435e0951-36ff-4270-b9f3-ed3b7c21d3c7" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff46b3a-0439-48db-89a5-b79a5265d931]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:22 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 Jun 04 15:00:22 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:23 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.669s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:23 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7" returned: 0 in 0.722s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:23 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7 Jun 04 15:00:23 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:23 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-435e0951-36ff-4270-b9f3-ed3b7c21d3c7" returned: 0 in 0.620s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-435e0951-36ff-4270-b9f3-ed3b7c21d3c7" released by "delete_volume" :: held 1.389s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Created reservations ['fceb7dc8-fac8-437b-9f04-6fb672e1204a', 'a3070255-da02-4703-be9f-60a1652564cf', '2fadee02-026b-4e37-8d12-60a65063fa11', '03089b34-3468-42a0-8586-f185df25297f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:24 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:24 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:24 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.621s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Deleted volume successfully. Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9c75e979-ad20-447c-b0bc-b98026470c52 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-435e0951-36ff-4270-b9f3-ed3b7c21d3c7-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-243f9f17-0ce7-4968-9837-e91f96fc8965-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-243f9f17-0ce7-4968-9837-e91f96fc8965-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-quobyte-243f9f17-0ce7-4968-9837-e91f96fc8965" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-243f9f17-0ce7-4968-9837-e91f96fc8965" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5346ad8-15a7-48e9-9d91-2ee4c7c49162]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:24 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 Jun 04 15:00:24 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:25 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965" returned: 0 in 0.721s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:25 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965 Jun 04 15:00:25 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:26 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-243f9f17-0ce7-4968-9837-e91f96fc8965" returned: 0 in 0.601s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-243f9f17-0ce7-4968-9837-e91f96fc8965" released by "delete_volume" :: held 1.361s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Created reservations ['8cd692e3-3366-44e9-8b31-66a164a91bf8', '173fd50b-a31c-4ca6-af74-ec7f799f9b6d', '885e24b1-4b43-4f29-9240-c37938278bc1', '4e2fec4c-c5da-4afc-9ea6-10c063d76fd8'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:26 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:26 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-8db93319-992c-472a-bece-9dbf0d739e20-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-8db93319-992c-472a-bece-9dbf0d739e20-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-quobyte-8db93319-992c-472a-bece-9dbf0d739e20" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-8db93319-992c-472a-bece-9dbf0d739e20" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c7d435-0504-41c1-973e-b37de2c64b35]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:27 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 Jun 04 15:00:27 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:27 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.117s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:27 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Deleted volume successfully. Jun 04 15:00:27 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-065bb81c-dbfd-4a8b-aaa0-b5861127e867 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-243f9f17-0ce7-4968-9837-e91f96fc8965-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:28 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20" returned: 0 in 0.817s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:28 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20 Jun 04 15:00:28 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:28 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8db93319-992c-472a-bece-9dbf0d739e20" returned: 0 in 0.651s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-8db93319-992c-472a-bece-9dbf0d739e20" released by "delete_volume" :: held 1.546s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Created reservations ['622b6ce6-5a72-4c4f-a3eb-e18a2629d9db', '1c9ca7e3-5bd4-4b9f-9233-847641fd5eb4', '188f1b38-8236-469e-9c3b-29c3e87ca7e5', '576c2125-65c0-4a04-aa30-2954110b18a3'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:28 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:28 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-8148b297-99fb-4b82-b56d-509e09250ca4-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-8148b297-99fb-4b82-b56d-509e09250ca4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "cinder-quobyte-8148b297-99fb-4b82-b56d-509e09250ca4" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-8148b297-99fb-4b82-b56d-509e09250ca4" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:29 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.688s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Deleted volume successfully. Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e277c3e-2af2-4e41-83b8-506dc9112e6e]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-217a9859-fc68-4f07-9f35-ac7c97de6186 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-8db93319-992c-472a-bece-9dbf0d739e20-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:29 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 Jun 04 15:00:29 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:30 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4" returned: 0 in 0.761s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:30 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4 Jun 04 15:00:30 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:30 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8148b297-99fb-4b82-b56d-509e09250ca4" returned: 0 in 0.600s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-quobyte-8148b297-99fb-4b82-b56d-509e09250ca4" released by "delete_volume" :: held 1.463s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Created reservations ['63e25557-7137-4e82-8b7a-0378aaf53b34', '61c89185-c027-4668-bd8b-4095b6f372ab', 'd825a2e4-331a-42b0-adc4-5837aa0fcc9d', 'ae9e2c6a-7bbb-4fc9-ae36-5860063efcca'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:31 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:31 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:31 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.691s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Deleted volume successfully. Jun 04 15:00:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-ceb76ce1-a67e-476a-be1d-b5fc8045c280 tempest-CreateVolumesFromImageTest-55397983 None] Lock "cinder-8148b297-99fb-4b82-b56d-509e09250ca4-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Flow 'volume_create_manager' (b602c148-307d-4dee-9282-df634e993182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbd8a93-d4be-4979-9bbf-54c4adaeb20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbd8a93-d4be-4979-9bbf-54c4adaeb20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaec1100-9e0e-4432-b32e-5928f42b998c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70fad2c1eab499ea2b5367fe1fadd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:34Z,use_quota=True,user_id='4ea531485a1d445685965223f287e1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eba520a-cdb2-44db-aa7f-5f2d9e5697f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eba520a-cdb2-44db-aa7f-5f2d9e5697f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447aff21-e6aa-4e0e-945f-10d5740221cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447aff21-e6aa-4e0e-945f-10d5740221cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaec1100-9e0e-4432-b32e-5928f42b998c', 'volume_name': 'volume-aaec1100-9e0e-4432-b32e-5928f42b998c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1e5b58-a9d9-46d7-861c-97c3e6de3541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1e5b58-a9d9-46d7-861c-97c3e6de3541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75819078-fdce-4ee2-9e3f-e725f94cd496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:34 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Volume aaec1100-9e0e-4432-b32e-5928f42b998c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaec1100-9e0e-4432-b32e-5928f42b998c', 'volume_size': 1} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaec1100-9e0e-4432-b32e-5928f42b998c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70fad2c1eab499ea2b5367fe1fadd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:34Z,use_quota=True,user_id='4ea531485a1d445685965223f287e1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Creating volume aaec1100-9e0e-4432-b32e-5928f42b998c {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:34 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:34 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c 1073741824 Jun 04 15:00:34 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:35 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c 1073741824" returned: 0 in 0.771s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:35 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c Jun 04 15:00:35 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:35 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c" returned: 0 in 0.626s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:35 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75819078-fdce-4ee2-9e3f-e725f94cd496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaec1100-9e0e-4432-b32e-5928f42b998c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53da3b9d-5a63-4811-9868-853f3fa5ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:36 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Volume volume-aaec1100-9e0e-4432-b32e-5928f42b998c (aaec1100-9e0e-4432-b32e-5928f42b998c): created successfully Jun 04 15:00:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53da3b9d-5a63-4811-9868-853f3fa5ab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Flow 'volume_create_manager' (b602c148-307d-4dee-9282-df634e993182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:36 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-508a75cf-3cfa-4f89-95bd-e91a08fa6ad8 tempest-CinderUnicodeTest-1032175425 None] Created volume successfully. Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Flow 'volume_create_manager' (c1d254bf-77d3-4226-b6fd-88b6e21ce493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e0882f-c832-495f-826e-c11fd512a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e0882f-c832-495f-826e-c11fd512a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445612410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecafa527-b9e1-4703-a14a-0e22b77a3da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70fad2c1eab499ea2b5367fe1fadd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:37Z,use_quota=True,user_id='4ea531485a1d445685965223f287e1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058e4bdc-40f0-40fd-bf5f-4f7ce3c55cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058e4bdc-40f0-40fd-bf5f-4f7ce3c55cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c28d55c-f377-4357-ba2d-1564f3c65021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c28d55c-f377-4357-ba2d-1564f3c65021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecafa527-b9e1-4703-a14a-0e22b77a3da7', 'volume_name': 'volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbbaa0b-eab7-4692-bf55-2ecf117efe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbbaa0b-eab7-4692-bf55-2ecf117efe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30644f6c-e4cc-4836-a408-efe71cbf5e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:37 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Volume ecafa527-b9e1-4703-a14a-0e22b77a3da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7', 'volume_size': 1} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445612410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecafa527-b9e1-4703-a14a-0e22b77a3da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70fad2c1eab499ea2b5367fe1fadd6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:37Z,use_quota=True,user_id='4ea531485a1d445685965223f287e1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Creating volume ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:37 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:37 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 1073741824 Jun 04 15:00:37 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:37 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 1073741824" returned: 0 in 0.792s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:37 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 Jun 04 15:00:37 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:38 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7" returned: 0 in 0.626s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30644f6c-e4cc-4836-a408-efe71cbf5e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f940e7-aa9d-4385-8324-8b42ddc2513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:38 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Volume volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 (ecafa527-b9e1-4703-a14a-0e22b77a3da7): created successfully Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f940e7-aa9d-4385-8324-8b42ddc2513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Flow 'volume_create_manager' (c1d254bf-77d3-4226-b6fd-88b6e21ce493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fcbaa17f-ad05-4b22-9131-70ec0d5cfcde tempest-CinderUnicodeTest-1032175425 None] Created volume successfully. Jun 04 15:00:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Creating offline snapshot 6daf987b-4b41-4d5b-9974-ed2085ecdd4c of volume ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:00:39 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248b944-4018-47ed-af25-2232e21cc2b5]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:39 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 Jun 04 15:00:39 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:40 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7" returned: 0 in 0.746s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:40 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c 1G Jun 04 15:00:40 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:41 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c 1G" returned: 0 in 0.801s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:41 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c Jun 04 15:00:41 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:41 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c" returned: 0 in 0.690s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:41 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c is being set with open permissions: ugo+rw Jun 04 15:00:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:41 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c Jun 04 15:00:41 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Acquiring lock "cinder-a193334d-5903-4c7c-88b3-fc2230fb74f7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Lock "cinder-a193334d-5903-4c7c-88b3-fc2230fb74f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Acquiring lock "cinder-quobyte-a193334d-5903-4c7c-88b3-fc2230fb74f7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Lock "cinder-quobyte-a193334d-5903-4c7c-88b3-fc2230fb74f7" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e0230-cc49-4599-b3ff-eb736f78818e]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:42 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c" returned: 0 in 0.601s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:42 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 Jun 04 15:00:42 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:42 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info Jun 04 15:00:42 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:42 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info" returned: 0 in 0.599s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:42 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info is being set with open permissions: ugo+rw Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:42 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7" returned: 0 in 0.704s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:42 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info Jun 04 15:00:42 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:42 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7 Jun 04 15:00:42 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:43 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.info" returned: 0 in 0.597s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:43 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.127s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a193334d-5903-4c7c-88b3-fc2230fb74f7" returned: 0 in 0.603s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Lock "cinder-quobyte-a193334d-5903-4c7c-88b3-fc2230fb74f7" released by "delete_volume" :: held 1.348s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:43 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3043c917-2e10-4d7b-b225-2438e23832b3 tempest-CinderUnicodeTest-1032175425 None] Create snapshot completed successfully Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Created reservations ['b5cd9ca6-7e36-497a-bc4b-3ae0da907998', 'cec4849a-0f59-406c-9d0c-61c1860f9680', '25f739f3-a309-4cf9-801d-af534821742f', '8c7e6b5c-0bfc-4dfd-b563-e1f058394f3b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:43 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:43 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:44 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.605s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Deleted volume successfully. Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f94a5a9b-f216-4753-b7e1-a38351e0f572 tempest-VolumesNegativeTest-1066610817 None] Lock "cinder-a193334d-5903-4c7c-88b3-fc2230fb74f7-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-6daf987b-4b41-4d5b-9974-ed2085ecdd4c-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-6daf987b-4b41-4d5b-9974-ed2085ecdd4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-quobyte-ecafa527-b9e1-4703-a14a-0e22b77a3da7" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-ecafa527-b9e1-4703-a14a-0e22b77a3da7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-quobyte-6daf987b-4b41-4d5b-9974-ed2085ecdd4c" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-6daf987b-4b41-4d5b-9974-ed2085ecdd4c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Deleting offline snapshot 6daf987b-4b41-4d5b-9974-ed2085ecdd4c of volume ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] snapshot_file for this snap is: volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba725b3-c78f-4d3a-8249-0d70be628ec6]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:44 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c Jun 04 15:00:44 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:45 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c" returned: 0 in 0.779s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:00:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[910deb5d-0cce-4674-b845-b0f6c5b46419]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:45 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 Jun 04 15:00:45 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:46 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7" returned: 0 in 0.783s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:46 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c Jun 04 15:00:46 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Flow 'volume_create_manager' (91ce3b4f-85c5-4b9d-9aa4-df71cb6a69b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c704e2-b13f-4222-ab97-f46aa9a564a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c704e2-b13f-4222-ab97-f46aa9a564a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1771030727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffd15aa-55e6-4f96-bfec-064cafa637b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea309f23add4622a69a1d5ba5d86b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:47Z,use_quota=True,user_id='d2a2e6409cf8490cb5e6050ebaf3c88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d63b6ad-3be0-4183-b366-f9162e898638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d63b6ad-3be0-4183-b366-f9162e898638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae61cad5-fd31-4f40-bf15-c49f1db0bbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae61cad5-fd31-4f40-bf15-c49f1db0bbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffd15aa-55e6-4f96-bfec-064cafa637b1', 'volume_name': 'volume-cffd15aa-55e6-4f96-bfec-064cafa637b1', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b077c-cc08-4b8e-b3a4-856e9c76b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b077c-cc08-4b8e-b3a4-856e9c76b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e26539c-1621-4108-a641-012f4b2306fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:46 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Volume cffd15aa-55e6-4f96-bfec-064cafa637b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffd15aa-55e6-4f96-bfec-064cafa637b1', 'volume_size': 1} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1771030727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffd15aa-55e6-4f96-bfec-064cafa637b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea309f23add4622a69a1d5ba5d86b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:00:47Z,use_quota=True,user_id='d2a2e6409cf8490cb5e6050ebaf3c88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Creating volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:00:46 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:00:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:46 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 1073741824 Jun 04 15:00:46 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:47 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:47 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c Jun 04 15:00:47 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:47 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 1073741824" returned: 0 in 0.772s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:47 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7.6daf987b-4b41-4d5b-9974-ed2085ecdd4c" returned: 0 in 0.645s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:47 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 Jun 04 15:00:47 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-6daf987b-4b41-4d5b-9974-ed2085ecdd4c" released by "_delete_snapshot" :: held 3.086s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-ecafa527-b9e1-4703-a14a-0e22b77a3da7" released by "delete_snapshot" :: held 3.111s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Created reservations ['3eeb3481-be41-438a-b7db-1a3d5ab50197', '60d06f30-880c-4113-9610-552e96cf935b', '60fb0156-baaf-46de-842e-d62620353bdb', '0533363d-9b16-4230-8afd-53d8c0df5644'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:47 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Delete snapshot completed successfully. Jun 04 15:00:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-22534262-0556-4fe8-938b-242c9c5d6403 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-6daf987b-4b41-4d5b-9974-ed2085ecdd4c-delete_snapshot" released by "delete_snapshot" :: held 3.256s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:48 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1" returned: 0 in 0.578s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e26539c-1621-4108-a641-012f4b2306fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffd15aa-55e6-4f96-bfec-064cafa637b1', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1999c231-fe70-4035-ba4a-fceedfcaa3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:00:48 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Volume volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 (cffd15aa-55e6-4f96-bfec-064cafa637b1): created successfully Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1999c231-fe70-4035-ba4a-fceedfcaa3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Flow 'volume_create_manager' (91ce3b4f-85c5-4b9d-9aa4-df71cb6a69b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:00:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4fd7f599-63f3-4172-9750-72ac4bf7b818 tempest-VolumesSnapshotListTestJSON-371594547 None] Created volume successfully. Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-ecafa527-b9e1-4703-a14a-0e22b77a3da7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-ecafa527-b9e1-4703-a14a-0e22b77a3da7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-quobyte-ecafa527-b9e1-4703-a14a-0e22b77a3da7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-ecafa527-b9e1-4703-a14a-0e22b77a3da7" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3f614-28c2-4611-a484-8a9d0fb1f7c5]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:49 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 Jun 04 15:00:49 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Creating offline snapshot 4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf of volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1721eb-3e2c-4538-874e-fdbed129fe00]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:49 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 Jun 04 15:00:49 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:49 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7" returned: 0 in 0.768s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:49 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7 Jun 04 15:00:49 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:49 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1" returned: 0 in 0.702s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:49 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf 1G Jun 04 15:00:49 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:50 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ecafa527-b9e1-4703-a14a-0e22b77a3da7" returned: 0 in 0.683s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-ecafa527-b9e1-4703-a14a-0e22b77a3da7" released by "delete_volume" :: held 1.518s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Created reservations ['9faf3817-6698-4e2f-b99b-abca197cdbf7', '4d1e3ac5-9ad9-425d-8657-49aaf95b0cda', '08b71ace-0322-460a-bdda-ea4072cb2610', '1e82652d-5b3d-49f1-8c5c-c2fc2e790837'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:50 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:50 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:50 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf 1G" returned: 0 in 0.840s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:50 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:00:50 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-aaec1100-9e0e-4432-b32e-5928f42b998c-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-aaec1100-9e0e-4432-b32e-5928f42b998c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "cinder-quobyte-aaec1100-9e0e-4432-b32e-5928f42b998c" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-aaec1100-9e0e-4432-b32e-5928f42b998c" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:00:51 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.635s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:51 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Deleted volume successfully. Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9f2cb-3630-4fcc-8e4f-24195f1c3699]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d20ae4df-255c-463c-8545-ef5609e4026f tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-ecafa527-b9e1-4703-a14a-0e22b77a3da7-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:51 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c Jun 04 15:00:51 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:51 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:51 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf is being set with open permissions: ugo+rw Jun 04 15:00:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:51 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:00:51 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:52 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c" returned: 0 in 0.776s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:52 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.595s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:52 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c Jun 04 15:00:52 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:52 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info Jun 04 15:00:52 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:52 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-aaec1100-9e0e-4432-b32e-5928f42b998c" returned: 0 in 0.603s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-quobyte-aaec1100-9e0e-4432-b32e-5928f42b998c" released by "delete_volume" :: held 1.431s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Created reservations ['fa95f41e-e292-4945-9674-5cc53c6e8a28', 'a2e64a56-74d3-48fb-a019-ddb3b36546d5', '5e0fb7d7-cb05-4d54-86e6-3ec8feeba928', '9cfd4c06-4303-4680-9ed1-b1bbca412dc8'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:00:52 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:52 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info is being set with open permissions: ugo+rw Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:52 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info Jun 04 15:00:52 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:52 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:00:52 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:53 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.info" returned: 0 in 0.594s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-41ba6e73-9389-4ee2-8e86-0ce389599da8 tempest-VolumesSnapshotListTestJSON-371594547 None] Create snapshot completed successfully Jun 04 15:00:53 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.603s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:53 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:00:53 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Deleted volume successfully. Jun 04 15:00:53 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5adf7fea-e782-420f-89d8-8e821622ce68 tempest-CinderUnicodeTest-1032175425 None] Lock "cinder-aaec1100-9e0e-4432-b32e-5928f42b998c-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:00:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Creating offline snapshot 3f0115cf-52bb-48a1-b38b-126699494dce of volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:00:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b979bbc8-68d3-42a1-8c91-c5c5ee6bb0d1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:54 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:00:54 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:55 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.699s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:00:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:55 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce 1G Jun 04 15:00:55 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:56 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce 1G" returned: 0 in 0.762s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:56 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:00:56 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:56 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.644s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:56 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce is being set with open permissions: ugo+rw Jun 04 15:00:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:56 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:00:56 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:57 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.575s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:00:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7ff6bc4f-1ce5-4008-a783-bb8c4d87e7bb tempest-VolumesSnapshotListTestJSON-371594547 None] Create snapshot completed successfully Jun 04 15:00:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:00:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:00:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Creating offline snapshot 373ff52d-ae69-4635-97c9-7c0d98324f52 of volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:00:58 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[81efef27-9a79-41dc-8fc9-20a1393f0c44]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:00:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:58 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:00:58 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:58 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.673s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:00:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:58 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 1G Jun 04 15:00:58 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:00:59 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jun 04 15:00:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 1G" returned: 0 in 0.777s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:00:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:00:59 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 Jun 04 15:00:59 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:00 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:00 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 is being set with open permissions: ugo+rw Jun 04 15:01:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:00 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 Jun 04 15:01:00 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:00 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52" returned: 0 in 0.608s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4d2d17d4-241f-41b6-852b-3b195a87436f tempest-VolumesSnapshotListTestJSON-371594547 None] Create snapshot completed successfully Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-373ff52d-ae69-4635-97c9-7c0d98324f52-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-373ff52d-ae69-4635-97c9-7c0d98324f52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-373ff52d-ae69-4635-97c9-7c0d98324f52" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-373ff52d-ae69-4635-97c9-7c0d98324f52" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Deleting offline snapshot 373ff52d-ae69-4635-97c9-7c0d98324f52 of volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] snapshot_file for this snap is: volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be54ea7-12e8-4f45-a3dd-9bd2763f4453]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:01 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 Jun 04 15:01:01 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:02 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52" returned: 0 in 0.688s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:01:02 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[70de41d2-9d9d-4834-bcbe-5a2a37b77f28]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:02 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:01:02 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:03 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.674s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:03 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:01:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:03 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 Jun 04 15:01:03 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:03 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52" returned: 0 in 0.731s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:04 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52 Jun 04 15:01:04 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:04 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.373ff52d-ae69-4635-97c9-7c0d98324f52" returned: 0 in 0.571s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-373ff52d-ae69-4635-97c9-7c0d98324f52" released by "_delete_snapshot" :: held 2.757s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" released by "delete_snapshot" :: held 2.778s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Created reservations ['d172e294-b31e-40f8-b06b-55de55e074f2', '514b4473-c2d3-4d8f-abf8-f8b0499855bb', 'b7084903-0a6c-4fb2-a70c-9998b8a3e344', 'a8ef8185-968a-43d4-9789-0e3d13e77e39'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:01:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Delete snapshot completed successfully. Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-eb1e9189-cdbe-43f1-9757-88fcd211838e tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-373ff52d-ae69-4635-97c9-7c0d98324f52-delete_snapshot" released by "delete_snapshot" :: held 2.905s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-3f0115cf-52bb-48a1-b38b-126699494dce-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-3f0115cf-52bb-48a1-b38b-126699494dce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-3f0115cf-52bb-48a1-b38b-126699494dce" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-3f0115cf-52bb-48a1-b38b-126699494dce" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Deleting offline snapshot 3f0115cf-52bb-48a1-b38b-126699494dce of volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] snapshot_file for this snap is: volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7fc30f-159a-4f27-addf-c2ce64b7a8cf]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:05 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:01:05 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:05 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.719s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7991e5-ee86-4f4c-aa8a-03c2a7e067d0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:05 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:01:05 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:06 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.710s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:01:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:06 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:01:06 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:07 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.690s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:07 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce Jun 04 15:01:07 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:07 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.3f0115cf-52bb-48a1-b38b-126699494dce" returned: 0 in 0.581s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-3f0115cf-52bb-48a1-b38b-126699494dce" released by "_delete_snapshot" :: held 2.794s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" released by "delete_snapshot" :: held 2.815s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Created reservations ['39745ae7-86a4-4710-90f9-bca21ae531ea', '3712cf9a-743e-4e9a-b187-67b67af70450', 'e6c04d41-7b78-41ad-aed8-660258ac69b6', 'be45b91d-f0dd-4dcf-8512-3ded288bd122'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:01:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Delete snapshot completed successfully. Jun 04 15:01:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c3167bcd-5705-476f-b564-8ac4c4da82fb tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-3f0115cf-52bb-48a1-b38b-126699494dce-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Deleting offline snapshot 4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf of volume cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] snapshot_file for this snap is: volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e870e-0960-4d6a-810b-e11b8904a803]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:08 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:01:08 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:08 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.715s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cffd15aa-55e6-4f96-bfec-064cafa637b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e791725-faba-4c75-83a5-186428c5e03a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:09 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 Jun 04 15:01:09 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:09 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:09 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:01:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1" returned: 0 in 0.686s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:09 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:10 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.695s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:10 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf Jun 04 15:01:10 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:10 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1.4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" returned: 0 in 0.597s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=89,cinder:INSERT=30,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=129,cinder:SELECT=80,cinder:DELETE=12,cinder:INSERT=25 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf" released by "_delete_snapshot" :: held 2.790s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" released by "delete_snapshot" :: held 2.812s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Created reservations ['3e07d2c6-aabd-4bcb-b86c-9648aef4dc5d', 'b0266a70-bea5-422b-8b1f-55296e9e7f9b', '7113097b-f956-4329-95ee-3cc480e24be3', 'd37e4991-fa34-4694-b61d-689f2eecfd98'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:01:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Delete snapshot completed successfully. Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f761337e-b0fd-466f-b2bb-baf32c70ef90 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-4dddebfe-fd50-4b6a-b2b4-1ad3304a35cf-delete_snapshot" released by "delete_snapshot" :: held 2.932s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-cffd15aa-55e6-4f96-bfec-064cafa637b1-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-cffd15aa-55e6-4f96-bfec-064cafa637b1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383e675-1d1f-42af-a6b5-c71c188c3b09]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:11 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 Jun 04 15:01:11 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:12 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1" returned: 0 in 0.680s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:12 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1 Jun 04 15:01:12 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:12 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-cffd15aa-55e6-4f96-bfec-064cafa637b1" returned: 0 in 0.581s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-quobyte-cffd15aa-55e6-4f96-bfec-064cafa637b1" released by "delete_volume" :: held 1.318s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Created reservations ['a9684825-3957-4499-930b-b9f03604a3ef', 'b882a7e9-334a-4029-b37d-0573a9ef8163', '82924d12-c2ed-4aca-8434-72fd4063d58a', 'a03a77f5-2280-4f51-a29d-24043572b267'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:12 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:01:12 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:13 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.570s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:13 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:01:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Deleted volume successfully. Jun 04 15:01:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e022d985-594c-462b-b090-071c734d78e2 tempest-VolumesSnapshotListTestJSON-371594547 None] Lock "cinder-cffd15aa-55e6-4f96-bfec-064cafa637b1-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:22 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:01:22 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:22 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=11 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:01:23 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.668s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:01:23 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:01:35 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:01:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Flow 'volume_create_manager' (f2982e94-be30-43ee-b545-d17d3dcb7161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:01:35 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec03533-3f43-4393-9482-a12fdffd08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec03533-3f43-4393-9482-a12fdffd08cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2141589181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5807b60b-7ddc-4128-bb7d-59402e2e4cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81a447e184f493abac987dd5e21f5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:01:36Z,use_quota=True,user_id='4ee33293fb0f4c5c81811f3ca8077018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(727b6955-b633-4871-bb93-1b61374872f1),volume_type_id=727b6955-b633-4871-bb93-1b61374872f1)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca095072-e665-4591-bc0c-bae05c2fd043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca095072-e665-4591-bc0c-bae05c2fd043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b1f948-3c50-4993-837f-7c80d9835962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b1f948-3c50-4993-837f-7c80d9835962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5807b60b-7ddc-4128-bb7d-59402e2e4cac', 'volume_name': 'volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59916d5-d84b-4e63-ae0b-434d5c8a49f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59916d5-d84b-4e63-ae0b-434d5c8a49f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c03690-d342-466d-9f3c-62f7ef418347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume 5807b60b-7ddc-4128-bb7d-59402e2e4cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac', 'volume_size': 1} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2141589181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5807b60b-7ddc-4128-bb7d-59402e2e4cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81a447e184f493abac987dd5e21f5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:01:36Z,use_quota=True,user_id='4ee33293fb0f4c5c81811f3ca8077018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(727b6955-b633-4871-bb93-1b61374872f1),volume_type_id=727b6955-b633-4871-bb93-1b61374872f1)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Creating volume 5807b60b-7ddc-4128-bb7d-59402e2e4cac {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:01:36 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:36 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac 1073741824 Jun 04 15:01:36 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Flow 'volume_create_manager' (72e542cb-3669-4db2-b032-99027157a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7269cc5-ad18-4bcc-8fb3-5a2425662615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7269cc5-ad18-4bcc-8fb3-5a2425662615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-666268389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff2fa91-6837-43fc-a9c3-dba2c3523ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81a447e184f493abac987dd5e21f5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:01:36Z,use_quota=True,user_id='4ee33293fb0f4c5c81811f3ca8077018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79b70c4f-34b7-4019-8976-e7af21f02942),volume_type_id=79b70c4f-34b7-4019-8976-e7af21f02942)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e740d387-6252-482a-84a7-48183d9421b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e740d387-6252-482a-84a7-48183d9421b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501c193-5663-43b2-8248-8b953ac5c10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501c193-5663-43b2-8248-8b953ac5c10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff2fa91-6837-43fc-a9c3-dba2c3523ce7', 'volume_name': 'volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8bb30a-7981-4c11-b79b-b6988e018d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8bb30a-7981-4c11-b79b-b6988e018d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c55071a-4811-493c-9e42-9c0b73a0508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume 1ff2fa91-6837-43fc-a9c3-dba2c3523ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7', 'volume_size': 1} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:36 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac 1073741824" returned: 0 in 0.819s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Flow 'volume_create_manager' (57880af6-9260-4d7d-9424-6ce739091334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efe2e7c-e9a2-4d40-80c1-db9e7a993263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efe2e7c-e9a2-4d40-80c1-db9e7a993263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094719880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ef4723-6be6-491a-8eb4-f569b0ce62f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81a447e184f493abac987dd5e21f5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:01:37Z,use_quota=True,user_id='4ee33293fb0f4c5c81811f3ca8077018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dae33a6-79ab-47a4-aeba-d1ced6b61d3e),volume_type_id=8dae33a6-79ab-47a4-aeba-d1ced6b61d3e)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac Jun 04 15:01:36 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4249dfd7-1069-4f59-b4ab-a542a3fe0dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4249dfd7-1069-4f59-b4ab-a542a3fe0dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67df3c62-cb95-42f4-b8fd-c6b30eac1bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:36 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67df3c62-cb95-42f4-b8fd-c6b30eac1bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74ef4723-6be6-491a-8eb4-f569b0ce62f2', 'volume_name': 'volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2', 'volume_size': 1, 'image_id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c949a6da-dcc5-42d2-8fae-8189caf217f2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--432090941', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c81a447e184f493abac987dd5e21f5fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'created_at': datetime.datetime(2026, 6, 4, 13, 1, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c949a6da-dcc5-42d2-8fae-8189caf217f2/file', 'properties': {}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895b0241-dd2f-4843-bb3a-7e417952fe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895b0241-dd2f-4843-bb3a-7e417952fe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25b8886-be9c-440a-9a66-0e0c7788d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:37 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume 74ef4723-6be6-491a-8eb4-f569b0ce62f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2', 'volume_size': 1, 'image_id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c949a6da-dcc5-42d2-8fae-8189caf217f2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--432090941', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c81a447e184f493abac987dd5e21f5fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'created_at': datetime.datetime(2026, 6, 4, 13, 1, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c949a6da-dcc5-42d2-8fae-8189caf217f2/file', 'properties': {}}, 'image_service': } Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Trying to clone 74ef4723-6be6-491a-8eb4-f569b0ce62f2 from image c949a6da-dcc5-42d2-8fae-8189caf217f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c949a6da-dcc5-42d2-8fae-8189caf217f2', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 15:01:37 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac" returned: 0 in 0.655s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.156s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-666268389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff2fa91-6837-43fc-a9c3-dba2c3523ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81a447e184f493abac987dd5e21f5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:01:36Z,use_quota=True,user_id='4ee33293fb0f4c5c81811f3ca8077018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79b70c4f-34b7-4019-8976-e7af21f02942),volume_type_id=79b70c4f-34b7-4019-8976-e7af21f02942)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Creating volume 1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:01:37 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:37 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 1073741824 Jun 04 15:01:37 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c03690-d342-466d-9f3c-62f7ef418347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62634f0-8988-44fc-ab5a-dcb8d440b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:37 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac (5807b60b-7ddc-4128-bb7d-59402e2e4cac): created successfully Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62634f0-8988-44fc-ab5a-dcb8d440b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Flow 'volume_create_manager' (f2982e94-be30-43ee-b545-d17d3dcb7161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:01:37 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ab8fbdfc-3fce-48c7-9db3-248333e5a304 tempest-TestInstancesWithCinderVolumes-116529472 None] Created volume successfully. Jun 04 15:01:38 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 1073741824" returned: 0 in 0.839s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:38 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 Jun 04 15:01:38 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:39 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" returned: 0 in 0.619s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c55071a-4811-493c-9e42-9c0b73a0508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef07853-361d-4ae4-80d8-8d3a3a7731a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:39 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 (1ff2fa91-6837-43fc-a9c3-dba2c3523ce7): created successfully Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef07853-361d-4ae4-80d8-8d3a3a7731a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:39 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Flow 'volume_create_manager' (72e542cb-3669-4db2-b032-99027157a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:01:39 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5af5e393-55c9-4600-8e3c-330e2cefaf06 tempest-TestInstancesWithCinderVolumes-116529472 None] Created volume successfully. Jun 04 15:01:40 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD, size 20.69 MB, duration 3.10 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 15:01:40 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Image download 20.69 MB at 6.67 MB/s Jun 04 15:01:40 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847b4ce-b498-415e-a6c6-2749e9bb745a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:40 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD Jun 04 15:01:40 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:41 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD" returned: 0 in 0.662s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Temporary image c949a6da-dcc5-42d2-8fae-8189caf217f2 is fetched for user 4ee33293fb0f4c5c81811f3ca8077018. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd56db72-74aa-4943-af17-41afe7f357f8]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:41 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD Jun 04 15:01:41 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:41 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094719880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ef4723-6be6-491a-8eb4-f569b0ce62f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81a447e184f493abac987dd5e21f5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:01:37Z,use_quota=True,user_id='4ee33293fb0f4c5c81811f3ca8077018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dae33a6-79ab-47a4-aeba-d1ced6b61d3e),volume_type_id=8dae33a6-79ab-47a4-aeba-d1ced6b61d3e)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Creating volume 74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:01:41 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:01:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:41 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 1073741824 Jun 04 15:01:41 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:42 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 1073741824" returned: 0 in 0.759s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:42 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:01:42 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:43 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 0 in 0.618s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Attempting download of c949a6da-dcc5-42d2-8fae-8189caf217f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c949a6da-dcc5-42d2-8fae-8189caf217f2', 'metadata': {}}])) to volume 74ef4723-6be6-491a-8eb4-f569b0ce62f2. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[084edc0d-1d0b-4543-8e2e-673f42256ae8]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:43 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry Jun 04 15:01:43 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:43 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry" returned: 0 in 0.643s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:44 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry Jun 04 15:01:44 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:44 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry" returned: 1 in 0.670s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c949a6da-dcc5-42d2-8fae-8189caf217f2_b4cslhry' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:01:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c96864-e804-48a9-9109-400e3702c952]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:44 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD Jun 04 15:01:44 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:45 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:45 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] c949a6da-dcc5-42d2-8fae-8189caf217f2 was qcow2, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 15:01:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:45 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:01:45 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:46 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 0 in 1.695s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:46 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c949a6da-dcc5-42d2-8fae-8189caf217f2_qczpy7v1devstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:01:46 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Converted 112.00 MB image at 66.02 MB/s Jun 04 15:01:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:47 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 1G Jun 04 15:01:47 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:47 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 1G" returned: 0 in 0.611s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:47 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a557233c-eced-4882-b35a-26fefadf695a]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:47 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:01:47 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:48 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 0 in 0.681s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:48 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:01:48 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:01:48 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 1 in 0.663s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Downloaded image c949a6da-dcc5-42d2-8fae-8189caf217f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c949a6da-dcc5-42d2-8fae-8189caf217f2', 'metadata': {}}])) to volume 74ef4723-6be6-491a-8eb4-f569b0ce62f2 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Temporary image c949a6da-dcc5-42d2-8fae-8189caf217f2 for user 4ee33293fb0f4c5c81811f3ca8077018 is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Marking volume 74ef4723-6be6-491a-8eb4-f569b0ce62f2 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Copying metadata from image c949a6da-dcc5-42d2-8fae-8189caf217f2 to 74ef4723-6be6-491a-8eb4-f569b0ce62f2. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 15:01:48 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Creating volume glance metadata for volume 74ef4723-6be6-491a-8eb4-f569b0ce62f2 backed by image c949a6da-dcc5-42d2-8fae-8189caf217f2 with: {'image_id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'image_name': 'tempest-scenario-img--432090941', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 15:01:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25b8886-be9c-440a-9a66-0e0c7788d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2', 'volume_size': 1, 'image_id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c949a6da-dcc5-42d2-8fae-8189caf217f2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--432090941', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c81a447e184f493abac987dd5e21f5fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c949a6da-dcc5-42d2-8fae-8189caf217f2', 'created_at': datetime.datetime(2026, 6, 4, 13, 1, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 1, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c949a6da-dcc5-42d2-8fae-8189caf217f2/file', 'properties': {}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82dd3be-723e-4ee7-8d54-2819ff26aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:01:49 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Volume volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 (74ef4723-6be6-491a-8eb4-f569b0ce62f2): created successfully Jun 04 15:01:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82dd3be-723e-4ee7-8d54-2819ff26aeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:01:49 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Flow 'volume_create_manager' (57880af6-9260-4d7d-9424-6ce739091334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:01:49 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6182390e-bd84-4ed9-867d-209951867345 tempest-TestInstancesWithCinderVolumes-116529472 None] Created volume successfully. Jun 04 15:01:59 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:01:59 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:01:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:01:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:01:59 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f0bf5-1eec-4d98-b19d-7ccb572c9ee0]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:01:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:01:59 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:01:59 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:00 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 0 in 0.732s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:00 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:02:00 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:00 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 1 in 0.711s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:02:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.480s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:02:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c38198f5-eb6e-4f02-8a80-23cdb6165449', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 15:02:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-9173d85d-e5b6-4c58-9b48-3272ef1afc51 req-1f2b32a2-8135-4bbc-878d-83aaf2b95da8 tempest-TestInstancesWithCinderVolumes-116529472 None] attachment_update completed successfully. Jun 04 15:02:10 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:02:10 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:22 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:02:22 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:22 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.594s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:22 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:02:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:02:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:02:36 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14382df-1c8a-4d79-a503-a23c950941a5]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:02:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:36 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac Jun 04 15:02:36 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:37 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac" returned: 0 in 0.712s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.730s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:02:37 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1699e8af-11fa-44d6-8728-ee2f5c0997af', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 15:02:37 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-fb0f1cbd-0cb3-4fd5-93a4-abfd46aaf67c req-1eea51b9-402d-40d3-920a-921fab027cbe tempest-TestInstancesWithCinderVolumes-116529472 None] attachment_update completed successfully. Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d19a17-2182-4ddc-8b32-799feb17a100]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:45 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 Jun 04 15:02:45 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:45 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" returned: 0 in 0.729s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.745s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:02:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975', 'name': 'volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0401e80c-7d92-49dd-9dd4-0e89a6b5c3b1', 'enforce_multipath': True} {{(pid=86522) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 04 15:02:45 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-9b083aa5-28bd-4dc1-9446-4b73b0123963 req-6bde45b6-8e45-4eef-ae77-828dd2821c6a tempest-TestInstancesWithCinderVolumes-116529472 None] attachment_update completed successfully. Jun 04 15:02:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-c1cb6bd8-201d-449c-9d87-cc721a370199 req-56ead9e6-1767-4a41-bb5b-e16a2c2a2fee tempest-TestInstancesWithCinderVolumes-116529472 None] Terminate volume connection completed successfully. Jun 04 15:02:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-c1cb6bd8-201d-449c-9d87-cc721a370199 req-56ead9e6-1767-4a41-bb5b-e16a2c2a2fee tempest-TestInstancesWithCinderVolumes-116529472 None] Deleting attachment 1699e8af-11fa-44d6-8728-ee2f5c0997af. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "cinder-5807b60b-7ddc-4128-bb7d-59402e2e4cac-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-5807b60b-7ddc-4128-bb7d-59402e2e4cac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "cinder-quobyte-5807b60b-7ddc-4128-bb7d-59402e2e4cac" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-quobyte-5807b60b-7ddc-4128-bb7d-59402e2e4cac" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce394a7-c5dd-40bf-85c6-75fef49a8a34]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:56 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac Jun 04 15:02:56 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:56 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac" returned: 0 in 0.747s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:56 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac Jun 04 15:02:56 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:57 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-5807b60b-7ddc-4128-bb7d-59402e2e4cac" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-quobyte-5807b60b-7ddc-4128-bb7d-59402e2e4cac" released by "delete_volume" :: held 1.518s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:02:57 devstack cinder-volume[86522]: WARNING cinder.quota [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1756522061-1809276043 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1756522061-1809276043, it is now deprecated. Please use the default quota class for default quota. Jun 04 15:02:57 devstack cinder-volume[86522]: WARNING cinder.quota [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1756522061-1809276043 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1756522061-1809276043, it is now deprecated. Please use the default quota class for default quota. Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Created reservations ['4814ecbd-4c12-4c99-8d25-1f89d3a86aa1', '178c8e46-476d-4baa-96c4-59a1ae91b31b', 'd5384180-414c-44f8-8b6d-c6484783823c', 'c387f4f2-b705-47d1-84f1-b0256c134c49'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:02:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:02:57 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:02:57 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:02:58 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jun 04 15:02:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.585s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:02:58 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:02:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Deleted volume successfully. Jun 04 15:02:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-6adb1120-10b0-434a-beae-f15a2d63fdee tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-5807b60b-7ddc-4128-bb7d-59402e2e4cac-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-f03635cc-0749-4e9e-9d6d-f9ddcd005c6c req-28c6e9cb-85bc-41aa-a9ae-52bc32cad9fb tempest-TestInstancesWithCinderVolumes-116529472 None] Terminate volume connection completed successfully. Jun 04 15:03:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-f03635cc-0749-4e9e-9d6d-f9ddcd005c6c req-28c6e9cb-85bc-41aa-a9ae-52bc32cad9fb tempest-TestInstancesWithCinderVolumes-116529472 None] Deleting attachment 0401e80c-7d92-49dd-9dd4-0e89a6b5c3b1. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 15:03:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "cinder-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "cinder-quobyte-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-quobyte-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:02 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c185a10-7a7c-4ae9-a973-206038073ec0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:02 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 Jun 04 15:03:02 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:03 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" returned: 0 in 0.795s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:03 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7 Jun 04 15:03:03 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:03 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" returned: 0 in 0.683s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-quobyte-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7" released by "delete_volume" :: held 1.523s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:03 devstack cinder-volume[86522]: WARNING cinder.quota [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251286591-535056369 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251286591-535056369, it is now deprecated. Please use the default quota class for default quota. Jun 04 15:03:03 devstack cinder-volume[86522]: WARNING cinder.quota [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251286591-535056369 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251286591-535056369, it is now deprecated. Please use the default quota class for default quota. Jun 04 15:03:03 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Created reservations ['9a3c5eb2-12e8-4213-9548-bb5e4779a17f', '72f997f3-4c80-4bfc-bbee-c6f7d1f9c833', '05ae6eaa-5947-4a6b-8437-b9a0f3bb46f1', 'aaed8a3e-8eb7-4d28-9c20-0bd66c092f85'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:04 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:03:04 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:04 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.675s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:03:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Deleted volume successfully. Jun 04 15:03:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e4ac4dba-cc4f-496a-8db9-ff42de404b52 tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-1ff2fa91-6837-43fc-a9c3-dba2c3523ce7-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:08 devstack cinder-volume[86522]: INFO cinder.volume.manager [req-a48e8261-4bb0-4101-850b-6fe240b040ab req-11762cf0-8641-4286-8cbd-45a642df4e08 tempest-TestInstancesWithCinderVolumes-116529472 None] Terminate volume connection completed successfully. Jun 04 15:03:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [req-a48e8261-4bb0-4101-850b-6fe240b040ab req-11762cf0-8641-4286-8cbd-45a642df4e08 tempest-TestInstancesWithCinderVolumes-116529472 None] Deleting attachment c38198f5-eb6e-4f02-8a80-23cdb6165449. {{(pid=86522) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 04 15:03:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "cinder-74ef4723-6be6-491a-8eb4-f569b0ce62f2-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-74ef4723-6be6-491a-8eb4-f569b0ce62f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "cinder-quobyte-74ef4723-6be6-491a-8eb4-f569b0ce62f2" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-quobyte-74ef4723-6be6-491a-8eb4-f569b0ce62f2" acquired by "delete_volume" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a75e7c-f7f3-4c00-8919-f4df89ceb7c0]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:11 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:03:11 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:12 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 0 in 0.675s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:12 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:03:12 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:13 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 1 in 0.658s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:13 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2 Jun 04 15:03:13 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:13 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-74ef4723-6be6-491a-8eb4-f569b0ce62f2" returned: 0 in 0.612s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-quobyte-74ef4723-6be6-491a-8eb4-f569b0ce62f2" released by "delete_volume" :: held 2.006s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:13 devstack cinder-volume[86522]: WARNING cinder.quota [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-548990363-1434271374 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-548990363-1434271374, it is now deprecated. Please use the default quota class for default quota. Jun 04 15:03:13 devstack cinder-volume[86522]: WARNING cinder.quota [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-548990363-1434271374 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-548990363-1434271374, it is now deprecated. Please use the default quota class for default quota. Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Created reservations ['1a3aff67-a2de-475c-9097-b32a125352e9', '26636890-5773-4a98-8c72-b3d16e2337ee', '407f649f-32f7-43ab-83d1-092fba2caa27', '649e47e3-b27f-47ca-ab61-1affb601efe5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:14 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:03:14 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:14 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.570s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:14 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:03:14 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Deleted volume successfully. Jun 04 15:03:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16c317d9-c0e3-4b83-a573-7e1d2bff0f4c tempest-TestInstancesWithCinderVolumes-116529472 None] Lock "cinder-74ef4723-6be6-491a-8eb4-f569b0ce62f2-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:22 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:03:22 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:23 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:03:23 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=31,cinder:UPDATE=32,cinder:INSERT=6 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Flow 'volume_create_manager' (9812f82b-e450-481c-abd4-614110c875b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c6ea6d-2272-429b-99c8-6af4af41b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c6ea6d-2272-429b-99c8-6af4af41b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1512762826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d33ee90-36d1-4e15-bb64-520f225b7987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3121c24979d4c72afec53513314c129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:03:25Z,use_quota=True,user_id='3bdcf587088747f4a7c3c378f1bc5e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2b5b16-712f-43b3-9f3c-d19f3aedb488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2b5b16-712f-43b3-9f3c-d19f3aedb488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77896b35-309f-4fa3-a057-aee3d88090dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77896b35-309f-4fa3-a057-aee3d88090dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d33ee90-36d1-4e15-bb64-520f225b7987', 'volume_name': 'volume-8d33ee90-36d1-4e15-bb64-520f225b7987', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df5b82f-58d9-473a-8720-db05855596dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df5b82f-58d9-473a-8720-db05855596dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aae8d2a-122a-4cbd-96c5-7b3df4914624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:24 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Volume 8d33ee90-36d1-4e15-bb64-520f225b7987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d33ee90-36d1-4e15-bb64-520f225b7987', 'volume_size': 1} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1512762826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d33ee90-36d1-4e15-bb64-520f225b7987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3121c24979d4c72afec53513314c129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:03:25Z,use_quota=True,user_id='3bdcf587088747f4a7c3c378f1bc5e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Creating volume 8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:03:24 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:03:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:24 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 1073741824 Jun 04 15:03:24 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:25 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 1073741824" returned: 0 in 0.783s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:25 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:25 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:26 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.574s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aae8d2a-122a-4cbd-96c5-7b3df4914624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d33ee90-36d1-4e15-bb64-520f225b7987', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b504fb5-9ba2-4e41-af77-2f404df1e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:26 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Volume volume-8d33ee90-36d1-4e15-bb64-520f225b7987 (8d33ee90-36d1-4e15-bb64-520f225b7987): created successfully Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b504fb5-9ba2-4e41-af77-2f404df1e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Flow 'volume_create_manager' (9812f82b-e450-481c-abd4-614110c875b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:03:26 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b69ba59c-0bd4-474c-89ef-3b9e6d6c048b tempest-VolumeDependencyTests-926505688 None] Created volume successfully. Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Creating offline snapshot b18acf3f-a95e-4892-83df-df46c4e1c4ce of volume 8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30cde59-cbaf-4ab0-bebf-48ad24823a75]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:27 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:27 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:27 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.738s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:27 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce 1G Jun 04 15:03:27 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:28 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce 1G" returned: 0 in 0.724s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d33ee90-36d1-4e15-bb64-520f225b7987 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:28 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d33ee90-36d1-4e15-bb64-520f225b7987 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce Jun 04 15:03:28 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:29 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d33ee90-36d1-4e15-bb64-520f225b7987 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce" returned: 0 in 0.636s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:29 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce is being set with open permissions: ugo+rw Jun 04 15:03:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:29 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce Jun 04 15:03:29 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:29 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce" returned: 0 in 0.574s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:29 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info Jun 04 15:03:29 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:30 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info" returned: 0 in 0.601s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:30 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info is being set with open permissions: ugo+rw Jun 04 15:03:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:30 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info Jun 04 15:03:30 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:30 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.info" returned: 0 in 0.572s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:30 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9a9ef735-e68c-4b38-bdf4-95f8390712c1 tempest-VolumeDependencyTests-926505688 None] Create snapshot completed successfully Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Flow 'volume_create_manager' (548abff4-ee34-4ec8-bd29-ac6cb2b2bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9ff5b9-3155-4822-89a1-a6018679c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9ff5b9-3155-4822-89a1-a6018679c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1566969384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cbef1f-fb04-4f2c-8b2d-91afa822d07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3121c24979d4c72afec53513314c129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b18acf3f-a95e-4892-83df-df46c4e1c4ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:03:31Z,use_quota=True,user_id='3bdcf587088747f4a7c3c378f1bc5e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efae809f-f03b-47f8-a33b-d5342293a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efae809f-f03b-47f8-a33b-d5342293a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d47e99-b7f1-413f-a9fe-9c18933975d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d47e99-b7f1-413f-a9fe-9c18933975d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87cbef1f-fb04-4f2c-8b2d-91afa822d07c', 'volume_name': 'volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c', 'volume_size': 1, 'snapshot_id': 'b18acf3f-a95e-4892-83df-df46c4e1c4ce'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c45fca-d4ef-4d9f-90e3-9d48e74c302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c45fca-d4ef-4d9f-90e3-9d48e74c302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28728d0-efa6-40a1-a7e8-34169c432de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:31 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Volume 87cbef1f-fb04-4f2c-8b2d-91afa822d07c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c', 'volume_size': 1, 'snapshot_id': 'b18acf3f-a95e-4892-83df-df46c4e1c4ce'} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-quobyte-b18acf3f-a95e-4892-83df-df46c4e1c4ce-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-b18acf3f-a95e-4892-83df-df46c4e1c4ce-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Creating volume 87cbef1f-fb04-4f2c-8b2d-91afa822d07c from snapshot b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-quobyte-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] snapshot: b18acf3f-a95e-4892-83df-df46c4e1c4ce, volume: 87cbef1f-fb04-4f2c-8b2d-91afa822d07c, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e10946c-e28f-4a34-89e8-6b999694ec55]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:31 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce Jun 04 15:03:31 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:32 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce" returned: 0 in 0.683s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d33ee90-36d1-4e15-bb64-520f225b7987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:03:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 15:03:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 15:03:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c23a31-9262-4d01-b019-1413fc3b6f97]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:32 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:32 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:33 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.710s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:33 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 15:03:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:33 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c Jun 04 15:03:33 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:37 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" returned: 0 in 4.396s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:37 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee03f8-3361-48b5-af85-b4d7ed908cb1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:37 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:37 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:38 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.850s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:03:38 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Converted 1024.00 MB image at 232.87 MB/s Jun 04 15:03:38 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c is being set with open permissions: ugo+rw Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:38 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c Jun 04 15:03:38 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:38 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" returned: 0 in 0.568s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" released by "_copy_volume_from_snapshot" :: held 7.291s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-b18acf3f-a95e-4892-83df-df46c4e1c4ce-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" released by "_create_volume_from_snapshot" :: held 7.319s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.334s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28728d0-efa6-40a1-a7e8-34169c432de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c', 'volume_size': 1, 'snapshot_id': 'b18acf3f-a95e-4892-83df-df46c4e1c4ce'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ed41d4-9078-4b63-822a-ccaf2bc2fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:03:38 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Volume volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c (87cbef1f-fb04-4f2c-8b2d-91afa822d07c): created successfully Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ed41d4-9078-4b63-822a-ccaf2bc2fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:03:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Flow 'volume_create_manager' (548abff4-ee34-4ec8-bd29-ac6cb2b2bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:03:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-20a66026-d1a9-46fe-81e2-7d7dddcb653e tempest-VolumeDependencyTests-926505688 None] Created volume successfully. Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-b18acf3f-a95e-4892-83df-df46c4e1c4ce-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Lock "cinder-b18acf3f-a95e-4892-83df-df46c4e1c4ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-quobyte-8d33ee90-36d1-4e15-bb64-520f225b7987" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-8d33ee90-36d1-4e15-bb64-520f225b7987" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-quobyte-b18acf3f-a95e-4892-83df-df46c4e1c4ce" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-b18acf3f-a95e-4892-83df-df46c4e1c4ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Deleting offline snapshot b18acf3f-a95e-4892-83df-df46c4e1c4ce of volume 8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] snapshot_file for this snap is: volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c844066-6a68-4be0-add1-ad93a03caf0a]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:39 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce Jun 04 15:03:39 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:39 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce" returned: 0 in 0.742s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d33ee90-36d1-4e15-bb64-520f225b7987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c566b97-16f8-431f-b586-b018b4c8c1a7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:40 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:40 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:40 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.686s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:40 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce Jun 04 15:03:40 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:41 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce" returned: 0 in 0.652s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:41 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce Jun 04 15:03:41 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:41 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987.b18acf3f-a95e-4892-83df-df46c4e1c4ce" returned: 0 in 0.570s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-b18acf3f-a95e-4892-83df-df46c4e1c4ce" released by "_delete_snapshot" :: held 2.739s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-8d33ee90-36d1-4e15-bb64-520f225b7987" released by "delete_snapshot" :: held 2.763s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:41 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Created reservations ['3d367437-6956-4325-89ae-733d9eb10b56', 'f225c3e6-5866-4ee4-8b54-9af4e2dc3a97', 'af29290e-5f61-4936-a10d-b2e4b320f11a', 'ca8e7414-2341-4fef-925c-c5d46f4e3761'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:03:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Delete snapshot completed successfully. Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4a2f3d54-3272-4bf9-ae19-ea603173c6a9 tempest-VolumeDependencyTests-926505688 None] Lock "cinder-b18acf3f-a95e-4892-83df-df46c4e1c4ce-delete_snapshot" released by "delete_snapshot" :: held 2.878s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-8d33ee90-36d1-4e15-bb64-520f225b7987-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Lock "cinder-8d33ee90-36d1-4e15-bb64-520f225b7987-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-quobyte-8d33ee90-36d1-4e15-bb64-520f225b7987" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-8d33ee90-36d1-4e15-bb64-520f225b7987" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f444b3-66a8-4e62-9ba6-b33a8c05ebda]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:42 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:42 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:43 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.664s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:43 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987 Jun 04 15:03:43 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:43 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-8d33ee90-36d1-4e15-bb64-520f225b7987" returned: 0 in 0.585s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-8d33ee90-36d1-4e15-bb64-520f225b7987" released by "delete_volume" :: held 1.302s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Created reservations ['78d4d3f7-c2b9-47f2-9374-0d44483649d7', '64047973-b1db-48e7-ab44-d1e6585b94b7', 'dbf6fa05-14b1-40a0-89e9-d4c3b2db0600', 'b4471fae-6f6c-4c55-a4b0-1e3db842e61a'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:43 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:03:43 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:44 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.569s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:03:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Deleted volume successfully. Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-10b7bfa2-aad9-4442-8cc5-5cf16dc571ba tempest-VolumeDependencyTests-926505688 None] Lock "cinder-8d33ee90-36d1-4e15-bb64-520f225b7987-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-87cbef1f-fb04-4f2c-8b2d-91afa822d07c-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Lock "cinder-87cbef1f-fb04-4f2c-8b2d-91afa822d07c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Acquiring lock "cinder-quobyte-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" acquired by "delete_volume" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c2938-d776-464a-9cbb-07be02c736ab]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:03:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:44 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c Jun 04 15:03:44 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:45 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" returned: 0 in 0.669s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:45 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c Jun 04 15:03:45 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:45 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" returned: 0 in 0.576s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Lock "cinder-quobyte-87cbef1f-fb04-4f2c-8b2d-91afa822d07c" released by "delete_volume" :: held 1.282s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Created reservations ['02b6ea68-ddc0-4186-b07e-5f03f5f18f67', 'edd601ed-8f61-4ff1-9469-0f058364d564', '382e9fd5-1097-4fbc-9061-9b6db05e1ba5', 'b84fc48d-5849-4b16-a31c-f229004836c8'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:03:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:03:45 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:03:45 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:03:46 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jun 04 15:03:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.573s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:03:46 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:03:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Deleted volume successfully. Jun 04 15:03:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-f71e86d5-9790-4ebd-8019-d6bd989318fd tempest-VolumeDependencyTests-926505688 None] Lock "cinder-87cbef1f-fb04-4f2c-8b2d-91afa822d07c-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:03:55 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:03:56 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=25,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Flow 'volume_create_manager' (3ce20da8-21c7-4481-ab27-620fca3b868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09d9268-44cd-43b1-ba67-5ef054785da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09d9268-44cd-43b1-ba67-5ef054785da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-104815043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b400189b-dccc-4405-ae0b-62ec5bd09540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a66eba65814dc594cb4d2b6bb2149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:09Z,use_quota=True,user_id='650b4cb1a5e14398b6be4c7359c906c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871ca367-463d-4a0f-922f-4f05c1446e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871ca367-463d-4a0f-922f-4f05c1446e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd31983c-16b5-4145-86a2-bef4b3e8d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd31983c-16b5-4145-86a2-bef4b3e8d564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b400189b-dccc-4405-ae0b-62ec5bd09540', 'volume_name': 'volume-b400189b-dccc-4405-ae0b-62ec5bd09540', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fde65e-3bde-4ba3-b2fb-99af3626bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fde65e-3bde-4ba3-b2fb-99af3626bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f7c19c-51e7-4852-a0c1-b4798c5b37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:08 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Volume b400189b-dccc-4405-ae0b-62ec5bd09540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b400189b-dccc-4405-ae0b-62ec5bd09540', 'volume_size': 1} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-104815043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b400189b-dccc-4405-ae0b-62ec5bd09540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a66eba65814dc594cb4d2b6bb2149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:09Z,use_quota=True,user_id='650b4cb1a5e14398b6be4c7359c906c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Creating volume b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:08 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:08 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 1073741824 Jun 04 15:04:08 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:09 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 1073741824" returned: 0 in 0.730s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:09 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:09 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:10 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.628s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f7c19c-51e7-4852-a0c1-b4798c5b37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b400189b-dccc-4405-ae0b-62ec5bd09540', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52ab61f-ed93-405c-b89f-9a6638b4e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:10 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Volume volume-b400189b-dccc-4405-ae0b-62ec5bd09540 (b400189b-dccc-4405-ae0b-62ec5bd09540): created successfully Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52ab61f-ed93-405c-b89f-9a6638b4e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:10 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Flow 'volume_create_manager' (3ce20da8-21c7-4481-ab27-620fca3b868d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2a49eaaa-088d-4212-9ac3-bd765980dd3e tempest-SnapshotDependencyTests-1577804589 None] Created volume successfully. Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Creating offline snapshot 2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f of volume b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[37826cec-ef8b-4199-9616-659047a3f250]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:11 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:11 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:11 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.687s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:11 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f 1G Jun 04 15:04:11 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:12 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f 1G" returned: 0 in 0.731s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b400189b-dccc-4405-ae0b-62ec5bd09540 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:12 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b400189b-dccc-4405-ae0b-62ec5bd09540 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f Jun 04 15:04:12 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:13 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b400189b-dccc-4405-ae0b-62ec5bd09540 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" returned: 0 in 0.643s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:13 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f is being set with open permissions: ugo+rw Jun 04 15:04:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:13 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f Jun 04 15:04:13 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:13 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" returned: 0 in 0.575s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:13 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info Jun 04 15:04:13 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:14 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info" returned: 0 in 0.565s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:14 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info is being set with open permissions: ugo+rw Jun 04 15:04:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:14 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info Jun 04 15:04:14 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:14 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.info" returned: 0 in 0.587s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.865s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:14 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ebf582d2-e563-4cc9-8578-ae1ff6bd3c04 tempest-SnapshotDependencyTests-1577804589 None] Create snapshot completed successfully Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Flow 'volume_create_manager' (1803bd07-c2dd-4c70-b75e-1457e78f8b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c1f0e2-f80a-46ea-a66d-18eddbbd905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c1f0e2-f80a-46ea-a66d-18eddbbd905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3213acd4-81d2-41f8-bc8f-035cf310268c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a66eba65814dc594cb4d2b6bb2149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:16Z,use_quota=True,user_id='650b4cb1a5e14398b6be4c7359c906c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfe7190-7dbb-411d-b4da-c72469210e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfe7190-7dbb-411d-b4da-c72469210e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705a64c9-a710-4710-b3c5-666a81306600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705a64c9-a710-4710-b3c5-666a81306600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3213acd4-81d2-41f8-bc8f-035cf310268c', 'volume_name': 'volume-3213acd4-81d2-41f8-bc8f-035cf310268c', 'volume_size': 1, 'snapshot_id': '2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9c47c1-80ad-476b-b42d-4e1d23f08074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9c47c1-80ad-476b-b42d-4e1d23f08074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccb9061-271b-440e-bc87-7e5b380e2602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Volume 3213acd4-81d2-41f8-bc8f-035cf310268c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3213acd4-81d2-41f8-bc8f-035cf310268c', 'volume_size': 1, 'snapshot_id': '2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f'} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-quobyte-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f-3213acd4-81d2-41f8-bc8f-035cf310268c" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f-3213acd4-81d2-41f8-bc8f-035cf310268c" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Creating volume 3213acd4-81d2-41f8-bc8f-035cf310268c from snapshot 2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-quobyte-3213acd4-81d2-41f8-bc8f-035cf310268c" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-3213acd4-81d2-41f8-bc8f-035cf310268c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] snapshot: 2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f, volume: 3213acd4-81d2-41f8-bc8f-035cf310268c, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3075ac-81ac-42a4-be65-10d8cff23ce7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:15 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f Jun 04 15:04:15 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:16 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" returned: 0 in 0.686s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b400189b-dccc-4405-ae0b-62ec5bd09540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:04:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 15:04:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 15:04:16 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[637156e7-1001-4d64-9904-e8cc1320eae9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:16 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:16 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:17 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.689s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:17 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 15:04:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:17 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c Jun 04 15:04:17 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:21 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c" returned: 0 in 4.214s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:21 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8831e9-59c8-45bd-be0e-c9119101d903]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:21 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:21 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:22 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.852s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:04:22 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Converted 1024.00 MB image at 242.94 MB/s Jun 04 15:04:22 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c is being set with open permissions: ugo+rw Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:22 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c Jun 04 15:04:22 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:22 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:04:22 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:22 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c" returned: 0 in 0.571s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-3213acd4-81d2-41f8-bc8f-035cf310268c" released by "_copy_volume_from_snapshot" :: held 7.097s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f-3213acd4-81d2-41f8-bc8f-035cf310268c" released by "_create_volume_from_snapshot" :: held 7.125s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.138s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccb9061-271b-440e-bc87-7e5b380e2602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3213acd4-81d2-41f8-bc8f-035cf310268c', 'volume_size': 1, 'snapshot_id': '2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784d7baf-be1b-46d4-886d-1c744d52ed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:22 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Volume volume-3213acd4-81d2-41f8-bc8f-035cf310268c (3213acd4-81d2-41f8-bc8f-035cf310268c): created successfully Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784d7baf-be1b-46d4-886d-1c744d52ed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Flow 'volume_create_manager' (1803bd07-c2dd-4c70-b75e-1457e78f8b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:22 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.583s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:22 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:04:22 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c6e6a182-56c6-4fd8-a556-8a762885ada6 tempest-SnapshotDependencyTests-1577804589 None] Created volume successfully. Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-quobyte-b400189b-dccc-4405-ae0b-62ec5bd09540" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-b400189b-dccc-4405-ae0b-62ec5bd09540" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-quobyte-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Deleting offline snapshot 2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f of volume b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] snapshot_file for this snap is: volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f6c4fd-e990-4c4a-9bb9-36df631d7cca]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:23 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f Jun 04 15:04:23 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:24 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" returned: 0 in 0.695s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b400189b-dccc-4405-ae0b-62ec5bd09540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:04:24 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbd49e7-7ff6-42d7-b811-5d14bbaa59a2]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:24 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:24 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:24 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.723s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:25 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f Jun 04 15:04:25 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:25 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" returned: 0 in 0.667s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:25 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f Jun 04 15:04:25 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:26 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540.2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" returned: 0 in 0.582s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f" released by "_delete_snapshot" :: held 2.764s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-b400189b-dccc-4405-ae0b-62ec5bd09540" released by "delete_snapshot" :: held 2.786s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Created reservations ['71d895e6-09b0-4bb2-a5aa-7fbb9211d82d', '71184b2f-c419-4fc4-ab20-8395f1e719b6', 'b17d043e-2e0b-44ed-8210-9685577ef37d', '7f800225-b249-44d2-abec-76038cfbb5bf'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:04:26 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Delete snapshot completed successfully. Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-2593c6c1-3bb0-4de7-af32-3f4215c8657b tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-2c2f56ed-794c-41ff-b0fe-3a2536bd1a0f-delete_snapshot" released by "delete_snapshot" :: held 2.907s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-b400189b-dccc-4405-ae0b-62ec5bd09540-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-b400189b-dccc-4405-ae0b-62ec5bd09540-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-quobyte-b400189b-dccc-4405-ae0b-62ec5bd09540" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-b400189b-dccc-4405-ae0b-62ec5bd09540" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[242ace4c-492c-41dd-9efb-4123d9df3cee]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:26 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:26 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:27 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.669s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:27 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540 Jun 04 15:04:27 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:27 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b400189b-dccc-4405-ae0b-62ec5bd09540" returned: 0 in 0.591s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-b400189b-dccc-4405-ae0b-62ec5bd09540" released by "delete_volume" :: held 1.312s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Created reservations ['fd224710-7f76-461a-94f5-a89c4d182cb6', '624ff8e1-0402-472b-ae0f-f868d2c87ec9', 'd08cd51d-197b-4395-b5cb-d524bf045da0', 'b9e1ea7b-c4c4-4f63-b85d-50f388d2d26f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:28 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:04:28 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:28 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.593s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:04:28 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Deleted volume successfully. Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-da94ffdf-c781-46c8-a99d-6327aa16aec7 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-b400189b-dccc-4405-ae0b-62ec5bd09540-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-3213acd4-81d2-41f8-bc8f-035cf310268c-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-3213acd4-81d2-41f8-bc8f-035cf310268c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "cinder-quobyte-3213acd4-81d2-41f8-bc8f-035cf310268c" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-3213acd4-81d2-41f8-bc8f-035cf310268c" acquired by "delete_volume" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9b5f6-f47d-4049-b3e5-fbd5059f5027]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:29 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c Jun 04 15:04:29 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:29 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c" returned: 0 in 0.693s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:29 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c Jun 04 15:04:29 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:30 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3213acd4-81d2-41f8-bc8f-035cf310268c" returned: 0 in 0.559s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-quobyte-3213acd4-81d2-41f8-bc8f-035cf310268c" released by "delete_volume" :: held 1.291s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Created reservations ['6fd89c12-8dc7-48dd-ab55-cc22559ff3e4', '5cf21813-d324-4c4e-91ee-6d7b4e55de98', 'f360685e-85bc-490c-8066-a65b336ebfbf', '450bf914-1f30-4100-8728-d5575b8ecd5f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:30 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:04:30 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:30 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.572s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:04:30 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Deleted volume successfully. Jun 04 15:04:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c7311b19-f8ad-4d10-9a6c-7b6cab7abfd2 tempest-SnapshotDependencyTests-1577804589 None] Lock "cinder-3213acd4-81d2-41f8-bc8f-035cf310268c-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:04:40 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=27,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:04:40 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (c738bdb6-a423-4ba1-8001-c661a054f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6480fd9-0a61-4194-86e3-b6938ca11bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6480fd9-0a61-4194-86e3-b6938ca11bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454599299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab77f46-ceb4-4038-89e9-c5a5630b6b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:50Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5abf08-9827-4646-984a-ceade6e84342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5abf08-9827-4646-984a-ceade6e84342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f198bf42-ec25-49fd-9ce3-0347fd10e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f198bf42-ec25-49fd-9ce3-0347fd10e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab77f46-ceb4-4038-89e9-c5a5630b6b60', 'volume_name': 'volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b54f1c0-f1e0-48ef-84e1-9269174993fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b54f1c0-f1e0-48ef-84e1-9269174993fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acd76fc-0536-447d-b4ec-0595bf405782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Volume 0ab77f46-ceb4-4038-89e9-c5a5630b6b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60', 'volume_size': 1} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454599299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab77f46-ceb4-4038-89e9-c5a5630b6b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:50Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Creating volume 0ab77f46-ceb4-4038-89e9-c5a5630b6b60 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:50 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:50 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 1073741824 Jun 04 15:04:50 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (adb2bc74-6f22-4207-bbe8-f4932de3fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1699531-0b50-475b-8ddd-5737f7e0efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1699531-0b50-475b-8ddd-5737f7e0efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592506063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe0743c-c360-4165-b5d9-1e224dea4dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:50Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8354011b-c45f-4eeb-b943-69e1b5c54eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8354011b-c45f-4eeb-b943-69e1b5c54eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a033ada7-d211-4d29-8b9a-2ad60b1689a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a033ada7-d211-4d29-8b9a-2ad60b1689a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe0743c-c360-4165-b5d9-1e224dea4dc7', 'volume_name': 'volume-afe0743c-c360-4165-b5d9-1e224dea4dc7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ef5e11-99fd-4743-8d45-70ba273bcb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ef5e11-99fd-4743-8d45-70ba273bcb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c40a80-8bfb-4ab3-996d-0472a94f992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume afe0743c-c360-4165-b5d9-1e224dea4dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe0743c-c360-4165-b5d9-1e224dea4dc7', 'volume_size': 1} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (c62d4f5f-7261-402d-aa18-6fc8eadc3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6827def8-d0ab-4da2-ab11-380379b4ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6827def8-d0ab-4da2-ab11-380379b4ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308949495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd6d97d-0af1-4728-bd52-20bac3dd7c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:50Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0b87ee-13d4-4a85-bc73-20137cb0d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0b87ee-13d4-4a85-bc73-20137cb0d60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e42d67-64af-48c9-bb01-95ec69c4b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e42d67-64af-48c9-bb01-95ec69c4b08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd6d97d-0af1-4728-bd52-20bac3dd7c9a', 'volume_name': 'volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cb24d7-e2ad-46c5-bb84-beed8cebc43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cb24d7-e2ad-46c5-bb84-beed8cebc43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413432a2-4562-4f90-9716-28840be22bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Volume 3bd6d97d-0af1-4728-bd52-20bac3dd7c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a', 'volume_size': 1} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (613cf235-8dee-4c9e-a310-89afc2ab3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743ed24b-7a9f-41f7-9e44-aa82915685ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743ed24b-7a9f-41f7-9e44-aa82915685ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863099374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6f29c4-0bea-404f-bd67-877c87ac71f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:51Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:50 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a906b8a2-91ec-42d5-a5fb-4f0806084fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a906b8a2-91ec-42d5-a5fb-4f0806084fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46e8beb-56f9-459b-87b9-a68310055130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46e8beb-56f9-459b-87b9-a68310055130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6f29c4-0bea-404f-bd67-877c87ac71f5', 'volume_name': 'volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b81a4ae-4b6e-405e-b717-943ec8a04eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b81a4ae-4b6e-405e-b717-943ec8a04eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038b1dab-83c1-440e-affc-fd8a8eef9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Volume 0c6f29c4-0bea-404f-bd67-877c87ac71f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5', 'volume_size': 1} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:51 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 1073741824" returned: 0 in 1.279s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (7da735ab-dee6-4735-a419-5aa493c47e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4fd75f-36d8-41fa-9e5a-25bbadd999eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4fd75f-36d8-41fa-9e5a-25bbadd999eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119521741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b7bf4e-4cf0-432a-b3c1-b5f5db71197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:51Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b62dcda-4205-4e70-a58f-eed3dcda1288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b62dcda-4205-4e70-a58f-eed3dcda1288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a71892-700f-4548-8c7e-6686864272e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a71892-700f-4548-8c7e-6686864272e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b7bf4e-4cf0-432a-b3c1-b5f5db71197f', 'volume_name': 'volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44decb2d-3c21-457b-a4bd-924c165aba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44decb2d-3c21-457b-a4bd-924c165aba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bdb1ea-032d-4776-add1-4837a56929c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Volume 46b7bf4e-4cf0-432a-b3c1-b5f5db71197f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f', 'volume_size': 1} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:51 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 Jun 04 15:04:51 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (7be3adf8-4219-4f85-9e4b-1b6721ce0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2b3f58-d3fc-4a85-a3a2-e979bccf8412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2b3f58-d3fc-4a85-a3a2-e979bccf8412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828585814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3016c0-93d9-4f46-a42e-a03e57ed7d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:52Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dda239-f66f-4545-a942-163e495808cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dda239-f66f-4545-a942-163e495808cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c677b2-1525-417c-add5-3ca6b69ebc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c677b2-1525-417c-add5-3ca6b69ebc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3016c0-93d9-4f46-a42e-a03e57ed7d56', 'volume_name': 'volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120571f4-982a-4ddd-8b64-ed026826f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120571f4-982a-4ddd-8b64-ed026826f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c642870-c688-4b46-a780-a202cd8dfc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:51 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Volume 9d3016c0-93d9-4f46-a42e-a03e57ed7d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56', 'volume_size': 1} Jun 04 15:04:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:52 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60" returned: 0 in 0.731s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592506063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe0743c-c360-4165-b5d9-1e224dea4dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:50Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating volume afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:52 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acd76fc-0536-447d-b4ec-0595bf405782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643caf83-70c3-4d51-91f8-d15151efda2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:52 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 1073741824 Jun 04 15:04:52 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:52 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Volume volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 (0ab77f46-ceb4-4038-89e9-c5a5630b6b60): created successfully Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643caf83-70c3-4d51-91f8-d15151efda2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:52 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (c738bdb6-a423-4ba1-8001-c661a054f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:52 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-cd1e9f1f-90ff-4ef9-95db-9e13dabee75d tempest-CreateVolumesFromImageTest-1768090688 None] Created volume successfully. Jun 04 15:04:53 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 1073741824" returned: 0 in 0.902s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:53 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 Jun 04 15:04:53 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Flow 'volume_create_manager' (65833d51-6f83-416e-b6e6-6cb4b30c3634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eafe2fb-4d36-4ba8-af87-e8ea71d585f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eafe2fb-4d36-4ba8-af87-e8ea71d585f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f020b6-fa23-41d3-af85-5a5c16ac1769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f89e5f07f34b068e1cb05fe0928de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:53Z,use_quota=True,user_id='6db022a9bf1f479ca2410f89c7aa3f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb37099d-b8b1-4197-9f26-1f3fa56be78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb37099d-b8b1-4197-9f26-1f3fa56be78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbda386b-bedc-443e-a3e6-d373262094b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 15:04:53 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7" returned: 0 in 0.643s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308949495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd6d97d-0af1-4728-bd52-20bac3dd7c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:50Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Creating volume 3bd6d97d-0af1-4728-bd52-20bac3dd7c9a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:53 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:53 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a 1073741824 Jun 04 15:04:53 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c40a80-8bfb-4ab3-996d-0472a94f992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe0743c-c360-4165-b5d9-1e224dea4dc7', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:53 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ea0bbe-5be9-4a51-928a-a1834247599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:53 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 (afe0743c-c360-4165-b5d9-1e224dea4dc7): created successfully Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ea0bbe-5be9-4a51-928a-a1834247599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (adb2bc74-6f22-4207-bbe8-f4932de3fc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d390fbee-cc8c-43f1-ae0b-2fe35eaa3866 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created volume successfully. Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbda386b-bedc-443e-a3e6-d373262094b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97f020b6-fa23-41d3-af85-5a5c16ac1769', 'volume_name': 'volume-97f020b6-fa23-41d3-af85-5a5c16ac1769', 'volume_size': 1, 'image_id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7583be2e-9df5-4fde-a1d1-cea6e125d061', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b168fb1957f0ca120750b613318c8f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '65f89e5f07f34b068e1cb05fe0928de3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72b6b32487da08fa6de7fd242533d3fd329c20b6881af297497c8d4fa27881e493c69b9601d8e65267944b3ebe2672000de15f2e4e760e387af23d0735574aa9', 'id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'created_at': datetime.datetime(2026, 6, 4, 13, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 4, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7583be2e-9df5-4fde-a1d1-cea6e125d061/file', 'properties': {}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711897f2-3d1d-488a-9979-a1e2718f4dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711897f2-3d1d-488a-9979-a1e2718f4dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408d9661-6b0c-47dd-a113-089705eb5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Volume 97f020b6-fa23-41d3-af85-5a5c16ac1769: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97f020b6-fa23-41d3-af85-5a5c16ac1769', 'volume_size': 1, 'image_id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7583be2e-9df5-4fde-a1d1-cea6e125d061', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b168fb1957f0ca120750b613318c8f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '65f89e5f07f34b068e1cb05fe0928de3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72b6b32487da08fa6de7fd242533d3fd329c20b6881af297497c8d4fa27881e493c69b9601d8e65267944b3ebe2672000de15f2e4e760e387af23d0735574aa9', 'id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'created_at': datetime.datetime(2026, 6, 4, 13, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 4, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7583be2e-9df5-4fde-a1d1-cea6e125d061/file', 'properties': {}}, 'image_service': } Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Trying to clone 97f020b6-fa23-41d3-af85-5a5c16ac1769 from image 7583be2e-9df5-4fde-a1d1-cea6e125d061 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7583be2e-9df5-4fde-a1d1-cea6e125d061', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 15:04:54 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Image download 0.00 MB at 0.00 MB/s Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Flow 'volume_create_manager' (aa59d0eb-a90b-46d9-9380-e15e9761511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568775fb-e1f8-4f43-92e8-c5b9ead1ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a591065-4bf6-4eae-a076-45370ecc1947]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568775fb-e1f8-4f43-92e8-c5b9ead1ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4755567-061e-402f-bbf4-9f145631db76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58a98df6d70418fb2ede79785927486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:54Z,use_quota=True,user_id='301deb807c84489cbf460be014cf051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f54eefe4-4e7b-4f19-b74d-2a2f1a22506a),volume_type_id=f54eefe4-4e7b-4f19-b74d-2a2f1a22506a)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3b3e2d-17f0-4b34-a71f-de656457b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3b3e2d-17f0-4b34-a71f-de656457b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c016281-815b-434d-b7ef-a621fcc41eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.image.glance [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Creating Keystone auth plugin from conf {{(pid=86522) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 15:04:54 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD Jun 04 15:04:54 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c016281-815b-434d-b7ef-a621fcc41eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4755567-061e-402f-bbf4-9f145631db76', 'volume_name': 'volume-e4755567-061e-402f-bbf4-9f145631db76', 'volume_size': 1, 'image_id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5714411a-fea4-47d4-96cf-6d62273db0e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90e143ef864414f44105d62fe2b6b08a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd58a98df6d70418fb2ede79785927486', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f8c1da197f407065a7628b37345c474489097619d72322b28a1f5b40276dd30528cde8c29ae9054bd0f56cd82764a813eab36717f60eefb20ed8c975e15b64c', 'id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'created_at': datetime.datetime(2026, 6, 4, 13, 4, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5714411a-fea4-47d4-96cf-6d62273db0e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab5b46b-fbde-42f3-aad0-afc34293102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab5b46b-fbde-42f3-aad0-afc34293102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e582fd-0bc2-49cc-911e-fc3cacd3f915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:54 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Volume e4755567-061e-402f-bbf4-9f145631db76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4755567-061e-402f-bbf4-9f145631db76', 'volume_size': 1, 'image_id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5714411a-fea4-47d4-96cf-6d62273db0e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90e143ef864414f44105d62fe2b6b08a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd58a98df6d70418fb2ede79785927486', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f8c1da197f407065a7628b37345c474489097619d72322b28a1f5b40276dd30528cde8c29ae9054bd0f56cd82764a813eab36717f60eefb20ed8c975e15b64c', 'id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'created_at': datetime.datetime(2026, 6, 4, 13, 4, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5714411a-fea4-47d4-96cf-6d62273db0e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Trying to clone e4755567-061e-402f-bbf4-9f145631db76 from image 5714411a-fea4-47d4-96cf-6d62273db0e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5714411a-fea4-47d4-96cf-6d62273db0e5', 'metadata': {}}]). {{(pid=86522) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 04 15:04:54 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Image download 0.00 MB at 0.00 MB/s Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0992912-0954-49a0-aeaa-769b8b39b8d3]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:54 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD Jun 04 15:04:54 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:54 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a 1073741824" returned: 0 in 1.110s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:55 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a Jun 04 15:04:55 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:55 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD" returned: 0 in 0.829s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:55 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD Jun 04 15:04:55 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:55 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:55 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a" returned: 0 in 0.628s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.600s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863099374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6f29c4-0bea-404f-bd67-877c87ac71f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:51Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Creating volume 0c6f29c4-0bea-404f-bd67-877c87ac71f5 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:55 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:55 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD Jun 04 15:04:55 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413432a2-4562-4f90-9716-28840be22bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:55 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 1073741824 Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9a3c7f-cad6-4797-9005-4e67eac882ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:55 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:55 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Volume volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a (3bd6d97d-0af1-4728-bd52-20bac3dd7c9a): created successfully Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9a3c7f-cad6-4797-9005-4e67eac882ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (c62d4f5f-7261-402d-aa18-6fc8eadc3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:55 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8a5e0e4f-25af-4373-95b3-858c6d787bbe tempest-CreateVolumesFromImageTest-1768090688 None] Created volume successfully. Jun 04 15:04:55 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD" returned: 1 in 0.716s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Temporary image 7583be2e-9df5-4fde-a1d1-cea6e125d061 is fetched for user 6db022a9bf1f479ca2410f89c7aa3f9c. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc0ba2-1516-40b2-a62c-afae7e617af2]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:56 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD Jun 04 15:04:56 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:56 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD" returned: 1 in 0.720s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Temporary image 5714411a-fea4-47d4-96cf-6d62273db0e5 is fetched for user 301deb807c84489cbf460be014cf051f. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5ee25-ce0d-4255-a494-2cc51dc5e1bb]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:56 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD Jun 04 15:04:56 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:56 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 1073741824" returned: 0 in 0.921s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:56 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 Jun 04 15:04:56 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:56 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:56 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD Jun 04 15:04:56 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:57 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD" returned: 0 in 0.809s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:57 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5" returned: 0 in 0.618s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.727s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119521741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b7bf4e-4cf0-432a-b3c1-b5f5db71197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:51Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Creating volume 46b7bf4e-4cf0-432a-b3c1-b5f5db71197f {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:57 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038b1dab-83c1-440e-affc-fd8a8eef9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:57 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f 1073741824 Jun 04 15:04:57 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c38622-a98d-4a2a-a7a2-05b4c7a2ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:57 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Volume volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 (0c6f29c4-0bea-404f-bd67-877c87ac71f5): created successfully Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c38622-a98d-4a2a-a7a2-05b4c7a2ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:57 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD Jun 04 15:04:57 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (613cf235-8dee-4c9e-a310-89afc2ab3301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5278a6e8-ffb5-4c00-bd8b-96b0496f42e5 tempest-CreateVolumesFromImageTest-1768090688 None] Created volume successfully. Jun 04 15:04:57 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD" returned: 1 in 0.745s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:57 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD" returned: 1 in 0.748s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:04:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:58 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f 1073741824" returned: 0 in 0.814s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:58 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f Jun 04 15:04:58 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:58 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f" returned: 0 in 0.592s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.791s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828585814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3016c0-93d9-4f46-a42e-a03e57ed7d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c674948fa5c4b60af2f0abdf470452c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:52Z,use_quota=True,user_id='7a2abbd314184e8799b819b9947eb6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Creating volume 9d3016c0-93d9-4f46-a42e-a03e57ed7d56 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:04:58 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bdb1ea-032d-4776-add1-4837a56929c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:58 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 1073741824 Jun 04 15:04:58 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e1cb23-89e2-45d0-8fb5-68c9a6e31697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:04:58 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Volume volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f (46b7bf4e-4cf0-432a-b3c1-b5f5db71197f): created successfully Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e1cb23-89e2-45d0-8fb5-68c9a6e31697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:04:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (7da735ab-dee6-4735-a419-5aa493c47e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:04:58 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-23acb35f-d853-499b-bcec-13cccac4fa20 tempest-CreateVolumesFromImageTest-1768090688 None] Created volume successfully. Jun 04 15:04:59 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jun 04 15:04:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 1073741824" returned: 0 in 0.739s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:04:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:04:59 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 Jun 04 15:04:59 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:00 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56" returned: 0 in 0.612s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.592s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c642870-c688-4b46-a780-a202cd8dfc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5fc45b-8e8d-48e6-9a25-f327298444f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating offline snapshot d889b6a1-6ee4-4690-992f-8f949082697c of volume afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:05:00 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Volume volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 (9d3016c0-93d9-4f46-a42e-a03e57ed7d56): created successfully Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5fc45b-8e8d-48e6-9a25-f327298444f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Flow 'volume_create_manager' (7be3adf8-4219-4f85-9e4b-1b6721ce0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7260a5e-3586-4cb9-a99e-a43e03841420]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:00 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9c68f2c7-1ea2-4037-aac2-db970381747f tempest-CreateVolumesFromImageTest-1768090688 None] Created volume successfully. Jun 04 15:05:00 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 Jun 04 15:05:00 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-9d3016c0-93d9-4f46-a42e-a03e57ed7d56-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-9d3016c0-93d9-4f46-a42e-a03e57ed7d56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-quobyte-9d3016c0-93d9-4f46-a42e-a03e57ed7d56" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-9d3016c0-93d9-4f46-a42e-a03e57ed7d56" acquired by "delete_volume" :: waited 0.017s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[616fcca5-4c90-4f39-b569-49d48b605d7d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:00 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 Jun 04 15:05:00 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:00 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7" returned: 0 in 0.729s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:00 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:00 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c 1G Jun 04 15:05:00 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:01 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56" returned: 0 in 0.743s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:01 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56 Jun 04 15:05:01 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:01 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c 1G" returned: 0 in 0.805s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:01 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:01 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c Jun 04 15:05:01 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:02 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-9d3016c0-93d9-4f46-a42e-a03e57ed7d56" returned: 0 in 0.655s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-9d3016c0-93d9-4f46-a42e-a03e57ed7d56" released by "delete_volume" :: held 1.445s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Created reservations ['e72d0aa2-1cf1-48b7-a0cb-8ec8ee969ad7', '00c6393e-8ef6-4bc6-8d8e-4d421d3b55bc', '4473b00e-bf3a-450d-835e-958f5cd27e23', 'b84e3cb3-4b2e-45aa-a718-688df727acfd'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:02 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:02 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:02 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c" returned: 0 in 0.638s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:02 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c is being set with open permissions: ugo+rw Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:02 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c Jun 04 15:05:02 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-quobyte-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:02 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.672s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:02 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Deleted volume successfully. Jun 04 15:05:02 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c" returned: 0 in 0.626s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf14a088-bd7e-4696-80fd-3177cab3bf42]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:02 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:03 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-9a429a34-3a3e-4a29-a989-768507ebf97b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-9d3016c0-93d9-4f46-a42e-a03e57ed7d56-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:03 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info Jun 04 15:05:03 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:03 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f Jun 04 15:05:03 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:03 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info" returned: 0 in 0.586s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:03 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info is being set with open permissions: ugo+rw Jun 04 15:05:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:03 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info Jun 04 15:05:03 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:03 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f" returned: 0 in 0.695s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:03 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:03 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f Jun 04 15:05:03 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:04 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.info" returned: 0 in 0.572s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.085s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.749s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f020b6-fa23-41d3-af85-5a5c16ac1769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f89e5f07f34b068e1cb05fe0928de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:53Z,use_quota=True,user_id='6db022a9bf1f479ca2410f89c7aa3f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Creating volume 97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:04 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:04 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 1073741824 Jun 04 15:05:04 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:04 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-23682894-c5f2-447f-996e-593e62488fce tempest-CreateVolumesFromSnapshotTest-254603428 None] Create snapshot completed successfully Jun 04 15:05:04 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f" returned: 0 in 0.623s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f" released by "delete_volume" :: held 1.379s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Created reservations ['969ed3a5-2513-46dc-808b-76b576267019', '5cbd4871-3d6a-4835-b314-28861cbd8e65', '7fd5e83b-4faa-4141-b353-4173f47d5f7a', 'd73bcdc6-349c-4c5a-a0a7-6a7d174d0d02'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:04 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:04 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:05 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 1073741824" returned: 0 in 0.804s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-0c6f29c4-0bea-404f-bd67-877c87ac71f5-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:05 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.669s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:05 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:05 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:05 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Deleted volume successfully. Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-0c6f29c4-0bea-404f-bd67-877c87ac71f5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-748a51ee-13e9-46d8-b9a2-3b507bccf86d tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-46b7bf4e-4cf0-432a-b3c1-b5f5db71197f-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-quobyte-0c6f29c4-0bea-404f-bd67-877c87ac71f5" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-0c6f29c4-0bea-404f-bd67-877c87ac71f5" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdde8c6c-23fc-427f-a2d6-7daaf85a942c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:05 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 Jun 04 15:05:05 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (fa237a95-1354-4058-92fe-b3c78f07e688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27f5e2b-2146-4136-956b-253eafeb1af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27f5e2b-2146-4136-956b-253eafeb1af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-496946601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d19c4f-383f-4dfa-be58-66367209d67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:05Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d0cb33-5fc1-496b-8abe-2070e972eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d0cb33-5fc1-496b-8abe-2070e972eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8391d72c-b858-4617-b203-0da77b367f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8391d72c-b858-4617-b203-0da77b367f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d19c4f-383f-4dfa-be58-66367209d67b', 'volume_name': 'volume-b8d19c4f-383f-4dfa-be58-66367209d67b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6856b0ed-ff12-4f0b-b03b-c165c044df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6856b0ed-ff12-4f0b-b03b-c165c044df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2ca8d4-8aa1-4972-87c8-1d0cab39ee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume b8d19c4f-383f-4dfa-be58-66367209d67b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d19c4f-383f-4dfa-be58-66367209d67b', 'volume_size': 1} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (e6acb966-c0d4-4e06-9722-d3b37ab39dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8f6ee7-2e8c-45f1-b0a9-5a9aac2b5061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8f6ee7-2e8c-45f1-b0a9-5a9aac2b5061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758562777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c57797-4480-4738-8ddd-6c90158d82d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:06Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc6b2cc-2d81-46b8-a3fc-a1cd542ab8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc6b2cc-2d81-46b8-a3fc-a1cd542ab8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ec32d6-69a7-4006-a5ac-12966206429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ec32d6-69a7-4006-a5ac-12966206429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c57797-4480-4738-8ddd-6c90158d82d3', 'volume_name': 'volume-60c57797-4480-4738-8ddd-6c90158d82d3', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3ee0a0-b044-4c73-bf66-1349733edb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3ee0a0-b044-4c73-bf66-1349733edb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5321f19e-e560-4a62-8af3-f1e55b2640f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume 60c57797-4480-4738-8ddd-6c90158d82d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c57797-4480-4738-8ddd-6c90158d82d3', 'volume_size': 1} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 0 in 0.850s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.985s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4755567-061e-402f-bbf4-9f145631db76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58a98df6d70418fb2ede79785927486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:04:54Z,use_quota=True,user_id='301deb807c84489cbf460be014cf051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f54eefe4-4e7b-4f19-b74d-2a2f1a22506a),volume_type_id=f54eefe4-4e7b-4f19-b74d-2a2f1a22506a)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Creating volume e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:05 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:05 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Attempting download of 7583be2e-9df5-4fde-a1d1-cea6e125d061 ((None, [{'url': 'file:///opt/stack/data/glance/images/7583be2e-9df5-4fde-a1d1-cea6e125d061', 'metadata': {}}])) to volume 97f020b6-fa23-41d3-af85-5a5c16ac1769. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 15:05:05 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 1073741824 Jun 04 15:05:05 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccc880-4aee-4566-a5a9-c0f027227833]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:06 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5" returned: 0 in 0.915s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:06 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5 Jun 04 15:05:06 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:06 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a Jun 04 15:05:06 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (00d4efb5-731d-43e0-b258-84c7453aa9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ff142-b716-44d3-ac13-569c9237149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ff142-b716-44d3-ac13-569c9237149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146143421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:06Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18b1426-328f-4885-aef6-094a2a80e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18b1426-328f-4885-aef6-094a2a80e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6afb39-2f95-4398-b9ee-7d769149c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6afb39-2f95-4398-b9ee-7d769149c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f', 'volume_name': 'volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471b69f3-4e17-4cb2-bbfe-0fb7d5401bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471b69f3-4e17-4cb2-bbfe-0fb7d5401bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae644ad4-d87d-4c1c-8f19-6df2da0b9847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume 066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f', 'volume_size': 1} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:06 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 1073741824" returned: 0 in 0.941s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (22075ce4-b7f3-495f-848e-d43eeed32866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b61f363-e83e-4962-8708-ed28bde5fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0c6f29c4-0bea-404f-bd67-877c87ac71f5" returned: 0 in 0.796s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b61f363-e83e-4962-8708-ed28bde5fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431967879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910f1377-1af8-48e4-80d9-637e4efd95db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:07Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b7c5f4-0b9c-4788-bfea-633677966972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b7c5f4-0b9c-4788-bfea-633677966972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea7339f-5667-4838-8932-dff5d878a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea7339f-5667-4838-8932-dff5d878a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910f1377-1af8-48e4-80d9-637e4efd95db', 'volume_name': 'volume-910f1377-1af8-48e4-80d9-637e4efd95db', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d3db87-5af1-4244-af02-35bbe2978396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d3db87-5af1-4244-af02-35bbe2978396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:06 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e29143f-ee8b-4e49-96ca-471a56fc6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:07 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume 910f1377-1af8-48e4-80d9-637e4efd95db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910f1377-1af8-48e4-80d9-637e4efd95db', 'volume_size': 1} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a" returned: 0 in 0.952s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-0c6f29c4-0bea-404f-bd67-877c87ac71f5" released by "delete_volume" :: held 1.820s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:07 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:07 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Created reservations ['bea53433-06d7-47a5-a32e-5f08ae94e338', 'afcc4fb4-f1ce-450e-962c-9584be426e2e', 'e5d3f048-d621-41b8-8809-97a3d84a611a', '9d84583a-92e7-45be-9c16-a08340495268'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:07 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a Jun 04 15:05:07 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:07 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:07 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (d47b056b-65fb-4dc0-ac1b-024d09cbe24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9826ce1d-be24-4694-a012-edbe4ec3d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9826ce1d-be24-4694-a012-edbe4ec3d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-702301786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c13639-785e-4f6c-b508-40474ae59b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:07Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740ee357-5039-45ac-b4ad-6eef1b3a25ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740ee357-5039-45ac-b4ad-6eef1b3a25ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1df93f7-1ca8-4dd8-b7c7-90adfbd0315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1df93f7-1ca8-4dd8-b7c7-90adfbd0315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c13639-785e-4f6c-b508-40474ae59b4d', 'volume_name': 'volume-e3c13639-785e-4f6c-b508-40474ae59b4d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6faba29-e6ae-47e7-bba3-92e5a9b9d8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6faba29-e6ae-47e7-bba3-92e5a9b9d8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a41084-77e1-472b-9dba-89d994b4ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:07 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume e3c13639-785e-4f6c-b508-40474ae59b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c13639-785e-4f6c-b508-40474ae59b4d', 'volume_size': 1} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-quobyte-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a" acquired by "delete_volume" :: waited 0.026s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bcf153-ed16-425e-b515-ec8727275974]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:07 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a Jun 04 15:05:07 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:07 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a" returned: 1 in 0.787s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7583be2e-9df5-4fde-a1d1-cea6e125d061_84tyxz6a' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[611eaf64-ae24-42a6-8136-6757d1e6d902]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:07 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD Jun 04 15:05:07 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:07 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 0 in 0.877s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:07 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-496946601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d19c4f-383f-4dfa-be58-66367209d67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:05Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating volume b8d19c4f-383f-4dfa-be58-66367209d67b {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:07 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.736s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:07 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Deleted volume successfully. Jun 04 15:05:07 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b 1073741824 Jun 04 15:05:07 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Attempting download of 5714411a-fea4-47d4-96cf-6d62273db0e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5714411a-fea4-47d4-96cf-6d62273db0e5', 'metadata': {}}])) to volume e4755567-061e-402f-bbf4-9f145631db76. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 04 15:05:07 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1afe227b-d448-459e-abc3-497cd15c284b tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-0c6f29c4-0bea-404f-bd67-877c87ac71f5-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdadbcfc-4842-40ca-802f-720b1127bb5e]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:08 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr Jun 04 15:05:08 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:08 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a" returned: 0 in 0.906s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:08 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a Jun 04 15:05:08 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:08 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:08 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD Jun 04 15:05:08 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:08 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr" returned: 0 in 0.757s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:08 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b 1073741824" returned: 0 in 0.912s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:08 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b Jun 04 15:05:08 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:08 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr Jun 04 15:05:08 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:09 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a" returned: 0 in 0.646s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a" released by "delete_volume" :: held 1.620s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Created reservations ['454fde7b-7533-4836-98a4-0dd4297ce245', '900aa690-d2fe-46d1-b2e8-923f9fafea25', '679e87f1-70e3-469a-b197-636721b90116', '22b46e02-cfce-4009-9999-cee7e7f78cea'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:09 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:09 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:09 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD" returned: 1 in 0.745s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] 7583be2e-9df5-4fde-a1d1-cea6e125d061 was raw, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:09 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:09 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:09 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b" returned: 0 in 0.758s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:09 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.743s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758562777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c57797-4480-4738-8ddd-6c90158d82d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:06Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating volume 60c57797-4480-4738-8ddd-6c90158d82d3 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:09 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr" returned: 1 in 0.865s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5714411a-fea4-47d4-96cf-6d62273db0e5_ci_57skr' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed7f35-854e-462a-b719-d21be4614a21]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:09 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 1073741824 Jun 04 15:05:09 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2ca8d4-8aa1-4972-87c8-1d0cab39ee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d19c4f-383f-4dfa-be58-66367209d67b', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89176e9f-c5b6-4686-870e-a8360ab4617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:09 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume volume-b8d19c4f-383f-4dfa-be58-66367209d67b (b8d19c4f-383f-4dfa-be58-66367209d67b): created successfully Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89176e9f-c5b6-4686-870e-a8360ab4617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (fa237a95-1354-4058-92fe-b3c78f07e688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:09 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-bd900834-00bc-4a1a-b86e-7c80af0b9e1e tempest-CreateVolumesFromSnapshotTest-254603428 None] Created volume successfully. Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-0ab77f46-ceb4-4038-89e9-c5a5630b6b60-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-0ab77f46-ceb4-4038-89e9-c5a5630b6b60-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "cinder-quobyte-0ab77f46-ceb4-4038-89e9-c5a5630b6b60" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:09 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD Jun 04 15:05:09 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:09 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-0ab77f46-ceb4-4038-89e9-c5a5630b6b60" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[5820c85c-882b-4d5e-8685-dd20ce84726d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:10 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.759s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Deleted volume successfully. Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-85f148f5-89a9-494d-b51e-7fe9bac0e65e tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-3bd6d97d-0af1-4728-bd52-20bac3dd7c9a-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:10 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 Jun 04 15:05:10 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:10 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 0 in 0.894s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7583be2e-9df5-4fde-a1d1-cea6e125d061_jfmrbbc7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:05:10 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:10 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 1G Jun 04 15:05:10 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:10 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:10 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 1073741824" returned: 0 in 1.031s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:10 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 Jun 04 15:05:10 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:10 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD Jun 04 15:05:10 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:10 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60" returned: 0 in 0.933s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:10 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60 Jun 04 15:05:10 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:11 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 1G" returned: 0 in 0.729s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d551ae6-f02b-430e-abe5-52ae3399ddde]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:11 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:11 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:11 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD" returned: 1 in 0.724s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] 5714411a-fea4-47d4-96cf-6d62273db0e5 was raw, converting to raw {{(pid=86522) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:11 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3" returned: 0 in 0.708s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:11 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146143421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:06Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating volume 066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:11 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:11 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5321f19e-e560-4a62-8af3-f1e55b2640f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c57797-4480-4738-8ddd-6c90158d82d3', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:11 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f 1073741824 Jun 04 15:05:11 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c1a305-8a72-4944-8797-5ade266e11a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:11 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume volume-60c57797-4480-4738-8ddd-6c90158d82d3 (60c57797-4480-4738-8ddd-6c90158d82d3): created successfully Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c1a305-8a72-4944-8797-5ade266e11a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (e6acb966-c0d4-4e06-9722-d3b37ab39dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:11 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ea3be144-bcc2-4446-aa3d-f1a73ab82282 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created volume successfully. Jun 04 15:05:11 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-0ab77f46-ceb4-4038-89e9-c5a5630b6b60" returned: 0 in 0.789s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-quobyte-0ab77f46-ceb4-4038-89e9-c5a5630b6b60" released by "delete_volume" :: held 1.778s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Created reservations ['09557823-2591-4d02-b4fb-0cd90d0b1378', 'd869079a-44b6-4bbe-9b2a-1ab6520ec433', 'b0f41e52-7204-4eaa-9f7c-a4862320810a', '03940271-eac9-445c-8a7c-742c42cd83f5'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:11 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:11 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:11 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 0 in 0.861s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:12 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:12 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:12 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 0 in 1.025s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5714411a-fea4-47d4-96cf-6d62273db0e5_f4xyqyz9devstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:05:12 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:12 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f 1073741824" returned: 0 in 1.005s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:12 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 1G Jun 04 15:05:12 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:12 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f Jun 04 15:05:12 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:12 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.771s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:12 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Deleted volume successfully. Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7dae7321-572d-42db-a1f6-0dc60c1fd3d0 tempest-CreateVolumesFromImageTest-1768090688 None] Lock "cinder-0ab77f46-ceb4-4038-89e9-c5a5630b6b60-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:12 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 1 in 0.918s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Downloaded image 7583be2e-9df5-4fde-a1d1-cea6e125d061 ((None, [{'url': 'file:///opt/stack/data/glance/images/7583be2e-9df5-4fde-a1d1-cea6e125d061', 'metadata': {}}])) to volume 97f020b6-fa23-41d3-af85-5a5c16ac1769 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Temporary image 7583be2e-9df5-4fde-a1d1-cea6e125d061 for user 6db022a9bf1f479ca2410f89c7aa3f9c is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Marking volume 97f020b6-fa23-41d3-af85-5a5c16ac1769 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Copying metadata from image 7583be2e-9df5-4fde-a1d1-cea6e125d061 to 97f020b6-fa23-41d3-af85-5a5c16ac1769. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Creating volume glance metadata for volume 97f020b6-fa23-41d3-af85-5a5c16ac1769 backed by image 7583be2e-9df5-4fde-a1d1-cea6e125d061 with: {'image_id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5b168fb1957f0ca120750b613318c8f8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408d9661-6b0c-47dd-a113-089705eb5488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f020b6-fa23-41d3-af85-5a5c16ac1769', 'volume_size': 1, 'image_id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7583be2e-9df5-4fde-a1d1-cea6e125d061', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b168fb1957f0ca120750b613318c8f8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '65f89e5f07f34b068e1cb05fe0928de3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72b6b32487da08fa6de7fd242533d3fd329c20b6881af297497c8d4fa27881e493c69b9601d8e65267944b3ebe2672000de15f2e4e760e387af23d0735574aa9', 'id': '7583be2e-9df5-4fde-a1d1-cea6e125d061', 'created_at': datetime.datetime(2026, 6, 4, 13, 4, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 4, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7583be2e-9df5-4fde-a1d1-cea6e125d061/file', 'properties': {}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:12 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed2ecb7-3149-4c9c-ae24-c21ebbd03d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:13 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Volume volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 (97f020b6-fa23-41d3-af85-5a5c16ac1769): created successfully Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed2ecb7-3149-4c9c-ae24-c21ebbd03d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Flow 'volume_create_manager' (65833d51-6f83-416e-b6e6-6cb4b30c3634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-04effe9e-00bb-45b7-b977-9387d6c27bc6 tempest-VolumeImageDependencyTests-1943414665 None] Created volume successfully. Jun 04 15:05:13 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f" returned: 0 in 0.721s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.263s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431967879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910f1377-1af8-48e4-80d9-637e4efd95db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:07Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating volume 910f1377-1af8-48e4-80d9-637e4efd95db {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:13 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:13 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae644ad4-d87d-4c1c-8f19-6df2da0b9847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b3cbf8-f4b8-42f8-b2a1-6fb570d81970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:13 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db 1073741824 Jun 04 15:05:13 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 1G" returned: 0 in 0.833s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:13 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f (066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f): created successfully Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b3cbf8-f4b8-42f8-b2a1-6fb570d81970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (00d4efb5-731d-43e0-b258-84c7453aa9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e21379fb-afec-478d-b1af-0eb731f7d6f5 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created volume successfully. Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5abcafe-5006-4501-92f5-eae5832ac4f2]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:13 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:13 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Acquiring lock "cinder-97f020b6-fa23-41d3-af85-5a5c16ac1769-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Lock "cinder-97f020b6-fa23-41d3-af85-5a5c16ac1769-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Acquiring lock "cinder-quobyte-97f020b6-fa23-41d3-af85-5a5c16ac1769" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Lock "cinder-quobyte-97f020b6-fa23-41d3-af85-5a5c16ac1769" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b489f81d-bb69-4c14-8357-7c360e23396a]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:14 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 0 in 0.836s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:14 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db 1073741824" returned: 0 in 1.008s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:14 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:14 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:14 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:14 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:14 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db Jun 04 15:05:14 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:14 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 1 in 0.754s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Downloaded image 5714411a-fea4-47d4-96cf-6d62273db0e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5714411a-fea4-47d4-96cf-6d62273db0e5', 'metadata': {}}])) to volume e4755567-061e-402f-bbf4-9f145631db76 successfully. {{(pid=86522) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Temporary image 5714411a-fea4-47d4-96cf-6d62273db0e5 for user 301deb807c84489cbf460be014cf051f is deleted. {{(pid=86522) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.volume.volume_utils [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Marking volume e4755567-061e-402f-bbf4-9f145631db76 as bootable. {{(pid=86522) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Copying metadata from image 5714411a-fea4-47d4-96cf-6d62273db0e5 to e4755567-061e-402f-bbf4-9f145631db76. {{(pid=86522) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 15:05:14 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Creating volume glance metadata for volume e4755567-061e-402f-bbf4-9f145631db76 backed by image 5714411a-fea4-47d4-96cf-6d62273db0e5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '90e143ef864414f44105d62fe2b6b08a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86522) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 15:05:15 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 0 in 0.851s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e582fd-0bc2-49cc-911e-fc3cacd3f915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4755567-061e-402f-bbf4-9f145631db76', 'volume_size': 1, 'image_id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5714411a-fea4-47d4-96cf-6d62273db0e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90e143ef864414f44105d62fe2b6b08a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd58a98df6d70418fb2ede79785927486', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f8c1da197f407065a7628b37345c474489097619d72322b28a1f5b40276dd30528cde8c29ae9054bd0f56cd82764a813eab36717f60eefb20ed8c975e15b64c', 'id': '5714411a-fea4-47d4-96cf-6d62273db0e5', 'created_at': datetime.datetime(2026, 6, 4, 13, 4, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 13, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5714411a-fea4-47d4-96cf-6d62273db0e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a61b885-5b66-48fa-b7ff-68e71a7d4f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Volume volume-e4755567-061e-402f-bbf4-9f145631db76 (e4755567-061e-402f-bbf4-9f145631db76): created successfully Jun 04 15:05:15 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a61b885-5b66-48fa-b7ff-68e71a7d4f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Flow 'volume_create_manager' (aa59d0eb-a90b-46d9-9380-e15e9761511e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db" returned: 0 in 0.781s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.717s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-702301786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c13639-785e-4f6c-b508-40474ae59b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd4a9e33e674e8aac988a5c5be2b339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:07Z,use_quota=True,user_id='496f88221eed4f28aba929510fac32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Creating volume e3c13639-785e-4f6c-b508-40474ae59b4d {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:15 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3568c5ac-54c6-49ee-a59d-8b13687a9422 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Created volume successfully. Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e29143f-ee8b-4e49-96ca-471a56fc6f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910f1377-1af8-48e4-80d9-637e4efd95db', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:15 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d 1073741824 Jun 04 15:05:15 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434fc7ff-37dc-45fd-805c-a5d7d3f310e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:15 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:15 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:15 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume volume-910f1377-1af8-48e4-80d9-637e4efd95db (910f1377-1af8-48e4-80d9-637e4efd95db): created successfully Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434fc7ff-37dc-45fd-805c-a5d7d3f310e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (22075ce4-b7f3-495f-848e-d43eeed32866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:15 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-bee1856c-2597-47de-bea1-bd4fa4579929 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created volume successfully. Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Acquiring lock "cinder-e4755567-061e-402f-bbf4-9f145631db76-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "cinder-e4755567-061e-402f-bbf4-9f145631db76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:15 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 1 in 0.906s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:15 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769 Jun 04 15:05:15 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Acquiring lock "cinder-quobyte-e4755567-061e-402f-bbf4-9f145631db76" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "cinder-quobyte-e4755567-061e-402f-bbf4-9f145631db76" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8438c647-6dc2-4000-ba48-d7e1ae72e0bc]: (4, 'raw') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:16 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d 1073741824" returned: 0 in 1.025s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:16 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:16 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:16 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d Jun 04 15:05:16 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:16 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-97f020b6-fa23-41d3-af85-5a5c16ac1769" returned: 0 in 0.793s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Lock "cinder-quobyte-97f020b6-fa23-41d3-af85-5a5c16ac1769" released by "delete_volume" :: held 2.636s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Created reservations ['3a459862-1497-4f32-b315-93ce419f78a4', '9ad254dc-8dfb-4671-b857-c5a8188e32fd', 'a13d1852-7f5e-4b22-9775-9859bcfe4fa2', '13f54cea-0219-45d9-a14a-614ea47541e1'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:16 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d" returned: 0 in 0.763s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:16 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:16 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a41084-77e1-472b-9dba-89d994b4ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c13639-785e-4f6c-b508-40474ae59b4d', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:16 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d236db-6859-4cc0-9434-8431a2a3fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:17 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Volume volume-e3c13639-785e-4f6c-b508-40474ae59b4d (e3c13639-785e-4f6c-b508-40474ae59b4d): created successfully Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d236db-6859-4cc0-9434-8431a2a3fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:17 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Flow 'volume_create_manager' (d47b056b-65fb-4dc0-ac1b-024d09cbe24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 0 in 0.983s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0298c2ca-ca20-48d0-be93-fc991616c3e4 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created volume successfully. Jun 04 15:05:17 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:17 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-e3c13639-785e-4f6c-b508-40474ae59b4d-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-e3c13639-785e-4f6c-b508-40474ae59b4d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-e3c13639-785e-4f6c-b508-40474ae59b4d" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-e3c13639-785e-4f6c-b508-40474ae59b4d" acquired by "delete_volume" :: waited 0.025s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c9d6aa-c72b-4788-a888-2a2da093fe35]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:17 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.822s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:17 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Deleted volume successfully. Jun 04 15:05:17 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-16761aa4-d615-40ba-a93f-516fd77a9c2f tempest-VolumeImageDependencyTests-1943414665 None] Lock "cinder-97f020b6-fa23-41d3-af85-5a5c16ac1769-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:17 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d Jun 04 15:05:17 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:18 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 1 in 0.980s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76' failed. Not Retrying. {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:18 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76 Jun 04 15:05:18 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:18 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d" returned: 0 in 0.998s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:18 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d Jun 04 15:05:18 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:18 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e4755567-061e-402f-bbf4-9f145631db76" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "cinder-quobyte-e4755567-061e-402f-bbf4-9f145631db76" released by "delete_volume" :: held 2.779s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Created reservations ['d4626112-8c36-4e7e-9350-232e57f1d8e8', 'ca5be936-747b-41bd-8f18-6fffc286bb90', '4189f5ee-d68b-4da4-857b-65aa0eaf7bbf', '9ed53f48-c6ee-459c-bcbb-b96d55b4e02a'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:18 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:19 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:19 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e3c13639-785e-4f6c-b508-40474ae59b4d" returned: 0 in 0.844s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-e3c13639-785e-4f6c-b508-40474ae59b4d" released by "delete_volume" :: held 1.918s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['27fcf427-d19e-4656-9952-0e4ddeb5b002', '9d8fdd34-32e5-4b54-b242-2413c84d6970', '42e30502-5420-4ac5-b92e-70e3a5b90444', 'd4639077-b548-46f5-9e5e-431446e0b966'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-910f1377-1af8-48e4-80d9-637e4efd95db-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:19 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:19 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-910f1377-1af8-48e4-80d9-637e4efd95db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-910f1377-1af8-48e4-80d9-637e4efd95db" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-910f1377-1af8-48e4-80d9-637e4efd95db" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[363eca1b-5e36-446d-8e46-5bccdf0713d8]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:20 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.083s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:20 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Deleted volume successfully. Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-a8e710d1-fd9d-4602-9e8d-4713c8302d43 tempest-VolumeAndVolumeTypeFromImageTest-1192182518 None] Lock "cinder-e4755567-061e-402f-bbf4-9f145631db76-delete_volume" released by "delete_volume" :: held 4.185s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:20 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db Jun 04 15:05:20 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:20 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.905s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:20 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleted volume successfully. Jun 04 15:05:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c4bb963-9d90-4385-98e8-5f8917aeb2c8 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-e3c13639-785e-4f6c-b508-40474ae59b4d-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:21 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db" returned: 0 in 1.145s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:21 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db Jun 04 15:05:21 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:21 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-910f1377-1af8-48e4-80d9-637e4efd95db" returned: 0 in 0.769s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-910f1377-1af8-48e4-80d9-637e4efd95db" released by "delete_volume" :: held 1.995s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['ae3358fa-dd3b-44c6-b4f1-8250a58f27f8', 'f84a4ce4-5047-425c-9e07-4cdba47d3cf9', '5c527226-7bf3-478f-bd12-820d9c54bff3', '6ec3117b-b184-4c87-ab9a-2e34b6376210'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:22 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:22 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Flow 'volume_create_manager' (5c03c325-9db6-4400-97ee-a18cf5d56e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5396053b-9088-45b8-aebf-4392c36bc8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5396053b-9088-45b8-aebf-4392c36bc8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade539de-fa50-4888-b74d-19b94942be16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d29c4c293db45319b5b009715bd00de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:22Z,use_quota=True,user_id='acae3d6a723c448cb015ffcf36cd942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1eae9d-b286-4040-bd51-3974a97aaf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1eae9d-b286-4040-bd51-3974a97aaf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432c5c30-6881-46b9-aeec-3df05128eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432c5c30-6881-46b9-aeec-3df05128eba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade539de-fa50-4888-b74d-19b94942be16', 'volume_name': 'volume-ade539de-fa50-4888-b74d-19b94942be16', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860c152b-c59a-498e-ad30-0e66d293913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860c152b-c59a-498e-ad30-0e66d293913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a1488b-a8e2-4672-a0ed-488d6cdf33ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:22 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Volume ade539de-fa50-4888-b74d-19b94942be16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade539de-fa50-4888-b74d-19b94942be16', 'volume_size': 1} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade539de-fa50-4888-b74d-19b94942be16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d29c4c293db45319b5b009715bd00de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:22Z,use_quota=True,user_id='acae3d6a723c448cb015ffcf36cd942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Creating volume ade539de-fa50-4888-b74d-19b94942be16 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:22 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:22 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 1073741824 Jun 04 15:05:22 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:22 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:22 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:23 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.982s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:23 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleted volume successfully. Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-15a5da9c-4d92-4769-8fb9-b933c45c2333 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-910f1377-1af8-48e4-80d9-637e4efd95db-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:23 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 1.016s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf627eb3-893f-462c-bce7-e339c6d917e3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:23 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 1073741824" returned: 0 in 1.173s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:23 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f Jun 04 15:05:23 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:23 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 Jun 04 15:05:23 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:24 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16" returned: 0 in 0.796s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a1488b-a8e2-4672-a0ed-488d6cdf33ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade539de-fa50-4888-b74d-19b94942be16', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6799e6dd-296e-4130-b609-414a0e432195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:24 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f" returned: 0 in 1.038s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:24 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Volume volume-ade539de-fa50-4888-b74d-19b94942be16 (ade539de-fa50-4888-b74d-19b94942be16): created successfully Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6799e6dd-296e-4130-b609-414a0e432195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:24 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Flow 'volume_create_manager' (5c03c325-9db6-4400-97ee-a18cf5d56e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:24 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f Jun 04 15:05:24 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:24 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-2b077d80-59ad-4b36-81fb-96d4e021134e tempest-CinderUnicodeTest-2050076112 None] Created volume successfully. Jun 04 15:05:25 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f" returned: 0 in 0.696s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f" released by "delete_volume" :: held 1.808s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['1da7ceec-63de-4283-b24b-3e52ce08ee50', 'ea6bf6e7-06fa-437f-a028-5b8e7db13b10', '429052e2-dc1e-42a3-bd3b-7bb1595ff0cf', '40701ba0-7226-4bf5-9b45-0f33e5b37bc3'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:25 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:25 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-60c57797-4480-4738-8ddd-6c90158d82d3-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-60c57797-4480-4738-8ddd-6c90158d82d3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-60c57797-4480-4738-8ddd-6c90158d82d3" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-60c57797-4480-4738-8ddd-6c90158d82d3" acquired by "delete_volume" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[736ebd78-7a87-40eb-a0af-74b03dc3caee]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:25 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:26 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 Jun 04 15:05:26 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:26 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.765s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:26 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleted volume successfully. Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d80b111e-37b3-47d7-8fd3-b25472214495 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-066ccdb3-11b3-4a6f-bcdc-d8aa1b68891f-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Flow 'volume_create_manager' (1487f12f-8656-4633-a260-e5247071e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18d18e7-a9d4-476c-a3a8-f58f4b971af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18d18e7-a9d4-476c-a3a8-f58f4b971af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1403320003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d34fa6-b597-4fdc-9847-e879257a6290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d29c4c293db45319b5b009715bd00de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:27Z,use_quota=True,user_id='acae3d6a723c448cb015ffcf36cd942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc118e3-6fff-4c38-a6de-1aab40ce5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc118e3-6fff-4c38-a6de-1aab40ce5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f582fbc1-b42d-488a-85e4-50c42ea1d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f582fbc1-b42d-488a-85e4-50c42ea1d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d34fa6-b597-4fdc-9847-e879257a6290', 'volume_name': 'volume-d8d34fa6-b597-4fdc-9847-e879257a6290', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129d1e7a-eb4d-4383-93bc-d2bb26a75f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129d1e7a-eb4d-4383-93bc-d2bb26a75f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acf25a1-ade8-44c8-8b82-7f33791b43c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:26 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Volume d8d34fa6-b597-4fdc-9847-e879257a6290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d34fa6-b597-4fdc-9847-e879257a6290', 'volume_size': 1} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1403320003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d34fa6-b597-4fdc-9847-e879257a6290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d29c4c293db45319b5b009715bd00de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:27Z,use_quota=True,user_id='acae3d6a723c448cb015ffcf36cd942f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Creating volume d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:26 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:26 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:27 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 1073741824 Jun 04 15:05:27 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:27 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (a5f7678e-92de-4207-ba8f-293b4895e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199146e9-ecd3-400a-b644-b7939bd2883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3" returned: 0 in 1.514s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199146e9-ecd3-400a-b644-b7939bd2883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1851762344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d011ea-1673-49e7-b58d-51ab2e0a855c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:27Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:27 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3 Jun 04 15:05:27 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd43c87-1c05-4984-97ce-7696efe53e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd43c87-1c05-4984-97ce-7696efe53e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd0402f-ea81-4bdd-830c-760f5ccc5dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd0402f-ea81-4bdd-830c-760f5ccc5dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d011ea-1673-49e7-b58d-51ab2e0a855c', 'volume_name': 'volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dafbf5-33f0-45d0-bfea-743e86d6ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dafbf5-33f0-45d0-bfea-743e86d6ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb247bc-b565-4a48-bb99-e1686a236788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:27 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume e9d011ea-1673-49e7-b58d-51ab2e0a855c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c', 'volume_size': 1} Jun 04 15:05:27 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:28 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 1073741824" returned: 0 in 1.119s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:28 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 Jun 04 15:05:28 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:28 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-60c57797-4480-4738-8ddd-6c90158d82d3" returned: 0 in 0.678s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-60c57797-4480-4738-8ddd-6c90158d82d3" released by "delete_volume" :: held 2.265s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['22110f9d-507f-412e-a02a-07cc328f4acb', '93ca2087-72d5-43f0-8280-19c622f1def8', 'a46be0ce-5a7a-442a-b4fb-15c7735ecb49', 'd3052337-05a9-40a2-960a-837e4780cfdf'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:28 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:28 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-b8d19c4f-383f-4dfa-be58-66367209d67b-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-b8d19c4f-383f-4dfa-be58-66367209d67b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-b8d19c4f-383f-4dfa-be58-66367209d67b" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-b8d19c4f-383f-4dfa-be58-66367209d67b" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[0023f31d-57f9-4aaa-965b-a9493ac81f0c]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:28 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290" returned: 0 in 0.806s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1851762344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d011ea-1673-49e7-b58d-51ab2e0a855c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:27Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Creating volume e9d011ea-1673-49e7-b58d-51ab2e0a855c {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:28 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acf25a1-ade8-44c8-8b82-7f33791b43c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d34fa6-b597-4fdc-9847-e879257a6290', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:28 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c 1073741824 Jun 04 15:05:28 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d9a3ff-75a1-476e-b81a-1c6e73ce79af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:28 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b Jun 04 15:05:28 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:28 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Volume volume-d8d34fa6-b597-4fdc-9847-e879257a6290 (d8d34fa6-b597-4fdc-9847-e879257a6290): created successfully Jun 04 15:05:28 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d9a3ff-75a1-476e-b81a-1c6e73ce79af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:29 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Flow 'volume_create_manager' (1487f12f-8656-4633-a260-e5247071e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-324de5d7-c6ca-4bfa-8470-064c0bf313f7 tempest-CinderUnicodeTest-2050076112 None] Created volume successfully. Jun 04 15:05:29 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.745s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:29 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:29 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleted volume successfully. Jun 04 15:05:29 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-8cffcd11-6af2-4f06-b228-ea13191a9a4f tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-60c57797-4480-4738-8ddd-6c90158d82d3-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:29 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b" returned: 0 in 0.854s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:29 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:29 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b Jun 04 15:05:29 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:30 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c 1073741824" returned: 0 in 1.144s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:30 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c Jun 04 15:05:30 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:30 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b8d19c4f-383f-4dfa-be58-66367209d67b" returned: 0 in 0.743s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-b8d19c4f-383f-4dfa-be58-66367209d67b" released by "delete_volume" :: held 1.663s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['bf0d1a5e-025e-445f-abf3-963b1432fb3b', '47384afe-7fc2-4880-8d51-1cc9cf3475d2', '43c149aa-57f3-4762-bb00-f336b4291364', 'de219f8b-08cb-452e-af31-4763215c4cee'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:30 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:30 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:30 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c" returned: 0 in 0.746s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.667s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb247bc-b565-4a48-bb99-e1686a236788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbab2f96-0b83-460a-8fd6-258fe7b0fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Creating offline snapshot dc7b4932-15f2-4507-b605-588af247d1f2 of volume d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:05:30 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c (e9d011ea-1673-49e7-b58d-51ab2e0a855c): created successfully Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbab2f96-0b83-460a-8fd6-258fe7b0fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (a5f7678e-92de-4207-ba8f-293b4895e388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c348f3f9-5e5b-4a93-b9a7-44018528bdca]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:30 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-d889b6a1-6ee4-4690-992f-8f949082697c-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-bece7d87-1f5e-4d6b-9e14-a7f21a0ed2d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created volume successfully. Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-d889b6a1-6ee4-4690-992f-8f949082697c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-afe0743c-c360-4165-b5d9-1e224dea4dc7" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-afe0743c-c360-4165-b5d9-1e224dea4dc7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-d889b6a1-6ee4-4690-992f-8f949082697c" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-d889b6a1-6ee4-4690-992f-8f949082697c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleting offline snapshot d889b6a1-6ee4-4690-992f-8f949082697c of volume afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] snapshot_file for this snap is: volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28453e0-f977-4d40-a200-f9fd92167a2d]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:31 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 Jun 04 15:05:31 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:31 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c Jun 04 15:05:31 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:31 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.701s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:31 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleted volume successfully. Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-c2169de8-04b2-49c3-8e2d-7a0fb74c7729 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-b8d19c4f-383f-4dfa-be58-66367209d67b-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:31 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290" returned: 0 in 0.926s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:31 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:31 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 1G Jun 04 15:05:31 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:32 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c" returned: 0 in 0.903s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe0743c-c360-4165-b5d9-1e224dea4dc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9875a-5bc1-4743-910e-062d50df50c0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (b00b5204-3341-4c1b-ae05-7c4955128a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f54669b-5ead-4d49-9947-82dc728ab836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f54669b-5ead-4d49-9947-82dc728ab836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-512092061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244c0f9d-a055-4a10-82bb-91cf65435258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:32Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742467db-471d-488f-8854-bf3e5221f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742467db-471d-488f-8854-bf3e5221f117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0ac01-0b07-4301-8328-954d2e3cfb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 Jun 04 15:05:32 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0ac01-0b07-4301-8328-954d2e3cfb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244c0f9d-a055-4a10-82bb-91cf65435258', 'volume_name': 'volume-244c0f9d-a055-4a10-82bb-91cf65435258', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44880190-a5f1-4e85-9a07-55b974bfd0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44880190-a5f1-4e85-9a07-55b974bfd0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155ba2b5-e4df-47f8-b45c-170c1c2a012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume 244c0f9d-a055-4a10-82bb-91cf65435258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244c0f9d-a055-4a10-82bb-91cf65435258', 'volume_size': 1} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (8a548ef9-8637-4167-9e57-47bed312e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b31b43f-7003-4c6e-8381-56f1d2918d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b31b43f-7003-4c6e-8381-56f1d2918d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-585475946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc83560b-0992-46cf-97f9-b1db16ec559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:33Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f419921-af4f-4985-8de4-f48eed8493f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f419921-af4f-4985-8de4-f48eed8493f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2e3a56-8abe-449a-acb0-99e6b84685b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2e3a56-8abe-449a-acb0-99e6b84685b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc83560b-0992-46cf-97f9-b1db16ec559a', 'volume_name': 'volume-fc83560b-0992-46cf-97f9-b1db16ec559a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8e98da-82e6-41c9-9262-49de89ba6118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8e98da-82e6-41c9-9262-49de89ba6118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8084ba7-0f4c-4021-87d1-c5f10cabafdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:32 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume fc83560b-0992-46cf-97f9-b1db16ec559a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc83560b-0992-46cf-97f9-b1db16ec559a', 'volume_size': 1} Jun 04 15:05:32 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:33 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 1G" returned: 0 in 1.246s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d34fa6-b597-4fdc-9847-e879257a6290 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:33 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d34fa6-b597-4fdc-9847-e879257a6290 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 Jun 04 15:05:33 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (f758c9a2-b076-4bc9-8063-5fb349ef9c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31ba3ce-ecfd-4e81-8702-24dd8cb25c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31ba3ce-ecfd-4e81-8702-24dd8cb25c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520384332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e59a655-6a7a-472a-aab9-3f1b7a3490ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:33Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4910c303-cb81-44d5-b68a-4a9687f28105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4910c303-cb81-44d5-b68a-4a9687f28105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547e3889-c670-4264-9c97-788e737ad20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547e3889-c670-4264-9c97-788e737ad20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e59a655-6a7a-472a-aab9-3f1b7a3490ce', 'volume_name': 'volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94da8fe-9f01-46da-9787-ba8ad68a6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94da8fe-9f01-46da-9787-ba8ad68a6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a61a99-6daf-4dbc-a248-8b9c975af5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume 6e59a655-6a7a-472a-aab9-3f1b7a3490ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce', 'volume_size': 1} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:33 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7" returned: 0 in 1.298s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:33 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c Jun 04 15:05:33 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (72df7b4d-1ff8-4f37-9dc5-df0cd5d03324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329197b7-95b5-4ac7-b4ae-66f5ce755b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (329197b7-95b5-4ac7-b4ae-66f5ce755b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878247346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559fa7f0-124f-4344-a6c9-5e1be15e2807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:34Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da56b15c-27ca-45a2-8ae1-8124b92e77f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da56b15c-27ca-45a2-8ae1-8124b92e77f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32257a5-d8e2-4d08-b267-04043bf1c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32257a5-d8e2-4d08-b267-04043bf1c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559fa7f0-124f-4344-a6c9-5e1be15e2807', 'volume_name': 'volume-559fa7f0-124f-4344-a6c9-5e1be15e2807', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76d94e4-420e-4962-93da-99a106ceb88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76d94e4-420e-4962-93da-99a106ceb88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170ea79f-efdb-453d-91c6-58dc3b0e84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:33 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume 559fa7f0-124f-4344-a6c9-5e1be15e2807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559fa7f0-124f-4344-a6c9-5e1be15e2807', 'volume_size': 1} Jun 04 15:05:33 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:34 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d34fa6-b597-4fdc-9847-e879257a6290 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2" returned: 0 in 0.924s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:34 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 is being set with open permissions: ugo+rw Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:34 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 Jun 04 15:05:34 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (642f045a-7ccd-4b83-9af7-ac8aba82150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e973089-c14f-42f1-9543-e0594e3967ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e973089-c14f-42f1-9543-e0594e3967ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247095049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:34Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d499a24f-7a53-4a1b-bcd3-d1c67792a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d499a24f-7a53-4a1b-bcd3-d1c67792a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3451347e-f33c-4b9c-814f-d38996ae1580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3451347e-f33c-4b9c-814f-d38996ae1580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca', 'volume_name': 'volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34dff9a-2d5e-40c5-9daf-d69230677da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34dff9a-2d5e-40c5-9daf-d69230677da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31e7497-0603-467f-bd50-370e727dc577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:34 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca', 'volume_size': 1} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:34 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c" returned: 0 in 1.060s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:34 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c Jun 04 15:05:34 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:34 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2" returned: 0 in 0.744s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:34 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:34 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info Jun 04 15:05:34 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:35 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7.d889b6a1-6ee4-4690-992f-8f949082697c" returned: 0 in 0.703s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-d889b6a1-6ee4-4690-992f-8f949082697c" released by "_delete_snapshot" :: held 4.126s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-afe0743c-c360-4165-b5d9-1e224dea4dc7" released by "delete_snapshot" :: held 4.159s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['713eec7d-7b50-4a5f-a8c7-6c82baf6c420', '9c963f02-ccd3-4858-818f-30eeb0cb3625', '08ba2960-54c2-40f3-9be9-b25b52ced1e5', '6820e2c4-db8d-42f8-805a-49719084c328'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:35 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Delete snapshot completed successfully. Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-1b245a2d-9829-4b50-ab69-6e6c638548b9 tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-d889b6a1-6ee4-4690-992f-8f949082697c-delete_snapshot" released by "delete_snapshot" :: held 4.386s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:35 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info" returned: 0 in 0.838s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:35 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info is being set with open permissions: ugo+rw Jun 04 15:05:35 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:35 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info Jun 04 15:05:35 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:36 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.info" returned: 0 in 0.674s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.519s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.084s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-512092061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244c0f9d-a055-4a10-82bb-91cf65435258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:32Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Creating volume 244c0f9d-a055-4a10-82bb-91cf65435258 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:36 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-afe0743c-c360-4165-b5d9-1e224dea4dc7-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-afe0743c-c360-4165-b5d9-1e224dea4dc7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:36 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 1073741824 Jun 04 15:05:36 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:36 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-fe144596-8483-4bf0-91ed-89e1ca5a174a tempest-CinderUnicodeTest-2050076112 None] Create snapshot completed successfully Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "cinder-quobyte-afe0743c-c360-4165-b5d9-1e224dea4dc7" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-afe0743c-c360-4165-b5d9-1e224dea4dc7" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e469187-6855-4eab-acaf-b6556d06e8b9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-dc7b4932-15f2-4507-b605-588af247d1f2-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-dc7b4932-15f2-4507-b605-588af247d1f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-quobyte-d8d34fa6-b597-4fdc-9847-e879257a6290" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-d8d34fa6-b597-4fdc-9847-e879257a6290" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-quobyte-dc7b4932-15f2-4507-b605-588af247d1f2" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-dc7b4932-15f2-4507-b605-588af247d1f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Deleting offline snapshot dc7b4932-15f2-4507-b605-588af247d1f2 of volume d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] snapshot_file for this snap is: volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:05:36 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 Jun 04 15:05:36 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a92de9-56b8-40f7-8662-3763f16d5ba4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:36 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:37 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 Jun 04 15:05:37 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:37 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 1073741824" returned: 0 in 1.165s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:37 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7" returned: 0 in 1.019s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:37 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 Jun 04 15:05:37 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:37 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7 Jun 04 15:05:37 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:37 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2" returned: 0 in 1.089s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d34fa6-b597-4fdc-9847-e879257a6290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1190847-bcab-4b1b-8223-9ef179b016e1]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:37 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:38 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 Jun 04 15:05:38 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:38 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258" returned: 0 in 0.664s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.467s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-585475946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc83560b-0992-46cf-97f9-b1db16ec559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:33Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Creating volume fc83560b-0992-46cf-97f9-b1db16ec559a {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:38 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:38 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a 1073741824 Jun 04 15:05:38 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155ba2b5-e4df-47f8-b45c-170c1c2a012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244c0f9d-a055-4a10-82bb-91cf65435258', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d031d4-81c6-4d7a-99c4-6679936ef472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:38 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:38 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume volume-244c0f9d-a055-4a10-82bb-91cf65435258 (244c0f9d-a055-4a10-82bb-91cf65435258): created successfully Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d031d4-81c6-4d7a-99c4-6679936ef472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (b00b5204-3341-4c1b-ae05-7c4955128a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-afe0743c-c360-4165-b5d9-1e224dea4dc7" returned: 0 in 0.751s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:38 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-6b1350eb-28cc-458f-9aa7-557354cad161 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created volume successfully. Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-quobyte-afe0743c-c360-4165-b5d9-1e224dea4dc7" released by "delete_volume" :: held 1.870s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Created reservations ['4b3f4945-6088-42c1-8c57-36d2ff26dbdc', '6c1c35fb-a4d2-4f75-b47d-72cdb4058d4f', 'c1a661c2-2751-450e-8917-0bba259232f3', 'ae3cc588-7de0-404e-ab90-d6e211b52277'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:38 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:38 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:38 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:39 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290" returned: 0 in 1.297s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:39 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 Jun 04 15:05:39 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:39 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.768s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:39 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Deleted volume successfully. Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e1584f9c-a26b-4062-9f39-fa38b3d5036e tempest-CreateVolumesFromSnapshotTest-254603428 None] Lock "cinder-afe0743c-c360-4165-b5d9-1e224dea4dc7-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:39 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a 1073741824" returned: 0 in 1.369s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:39 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:39 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a Jun 04 15:05:39 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:40 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2" returned: 0 in 0.917s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:40 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2 Jun 04 15:05:40 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=129,cinder:UPDATE=168,cinder:INSERT=47,cinder:DELETE=16 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:05:40 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a" returned: 0 in 0.785s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.179s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520384332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e59a655-6a7a-472a-aab9-3f1b7a3490ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:33Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Creating volume 6e59a655-6a7a-472a-aab9-3f1b7a3490ce {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:40 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:40 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce 1073741824 Jun 04 15:05:40 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8084ba7-0f4c-4021-87d1-c5f10cabafdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc83560b-0992-46cf-97f9-b1db16ec559a', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efff0a47-baae-4e9b-875a-a889dcbbb7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:40 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume volume-fc83560b-0992-46cf-97f9-b1db16ec559a (fc83560b-0992-46cf-97f9-b1db16ec559a): created successfully Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efff0a47-baae-4e9b-875a-a889dcbbb7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (8a548ef9-8637-4167-9e57-47bed312e275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:40 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b4774334-a5ae-47c3-bdac-684d207d22d1 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created volume successfully. Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Flow 'volume_create_manager' (b7aab240-bb1a-469b-8f49-2d1628364cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4557ce0a-bb1e-4d4d-a8cc-f2b36555995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4557ce0a-bb1e-4d4d-a8cc-f2b36555995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-958454455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ee4ed-2771-4c0f-a17e-d8ce7deec735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13c4ebc49f7406b8b89a729374f6b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:41Z,use_quota=True,user_id='8ce3c401b9d04c339e736d1aab1bcaf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1553ed6-8237-49c5-b8fd-0d4b3908100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1553ed6-8237-49c5-b8fd-0d4b3908100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f0793f-4c30-4439-b0c2-934ef19f0dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f0793f-4c30-4439-b0c2-934ef19f0dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943ee4ed-2771-4c0f-a17e-d8ce7deec735', 'volume_name': 'volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0f5caf-6748-45ad-b20e-4da502dd3545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0f5caf-6748-45ad-b20e-4da502dd3545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04863caf-311f-4991-beb2-c92faeb8f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:40 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Volume 943ee4ed-2771-4c0f-a17e-d8ce7deec735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735', 'volume_size': 1} Jun 04 15:05:40 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:41 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290.dc7b4932-15f2-4507-b605-588af247d1f2" returned: 0 in 0.843s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=174,cinder:SELECT=129,cinder:INSERT=48,cinder:DELETE=17 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-dc7b4932-15f2-4507-b605-588af247d1f2" released by "_delete_snapshot" :: held 4.306s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-d8d34fa6-b597-4fdc-9847-e879257a6290" released by "delete_snapshot" :: held 4.337s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Created reservations ['46831075-1120-473b-b32d-410e3114cb06', '45ec50d8-35c3-46fc-963c-1a3e5f14dc71', '2e0587e4-bd37-4026-8f01-a77461c0cb0a', 'c009eb54-2e35-43e9-91ec-27697279c2cc'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:41 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Delete snapshot completed successfully. Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-b5245718-9d94-49c2-a9a4-4b1d0754689e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-dc7b4932-15f2-4507-b605-588af247d1f2-delete_snapshot" released by "delete_snapshot" :: held 4.484s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:41 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce 1073741824" returned: 0 in 1.023s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:41 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:41 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce Jun 04 15:05:41 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-d8d34fa6-b597-4fdc-9847-e879257a6290-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-d8d34fa6-b597-4fdc-9847-e879257a6290-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-quobyte-d8d34fa6-b597-4fdc-9847-e879257a6290" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-d8d34fa6-b597-4fdc-9847-e879257a6290" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:42 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce" returned: 0 in 0.632s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4c0ed-d6ea-40f4-9514-855e52715d51]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.338s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878247346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559fa7f0-124f-4344-a6c9-5e1be15e2807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:34Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Creating volume 559fa7f0-124f-4344-a6c9-5e1be15e2807 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:42 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:42 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 1073741824 Jun 04 15:05:42 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a61a99-6daf-4dbc-a248-8b9c975af5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086b16b0-b526-4a27-81b3-15165cf73184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce (6e59a655-6a7a-472a-aab9-3f1b7a3490ce): created successfully Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086b16b0-b526-4a27-81b3-15165cf73184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (f758c9a2-b076-4bc9-8063-5fb349ef9c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:42 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 Jun 04 15:05:42 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-918c1dd4-f6bd-43f6-8f97-ab5698c5e521 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created volume successfully. Jun 04 15:05:42 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Flow 'volume_create_manager' (ef8f5f01-8ffe-4e5f-8433-6ed5a654ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e29f405-bb5b-4cef-8e25-ca36fc484319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e29f405-bb5b-4cef-8e25-ca36fc484319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1272510120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54774fb3-d3d4-43f5-b010-6a80e5d9b3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7ba127d7a44c5a472f16bf7bb405e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:42Z,use_quota=True,user_id='c146acf7f37841989442655aaeeca72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca3ac72-36d5-4a19-b6ad-3234fd649554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca3ac72-36d5-4a19-b6ad-3234fd649554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3851d04-478a-4283-a4a7-2fc87c1a7e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3851d04-478a-4283-a4a7-2fc87c1a7e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54774fb3-d3d4-43f5-b010-6a80e5d9b3c5', 'volume_name': 'volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c8228b-4632-43d9-a254-e833d003cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c8228b-4632-43d9-a254-e833d003cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1605a7f3-ad66-4a53-8841-19a0f7ff49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:42 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Volume 54774fb3-d3d4-43f5-b010-6a80e5d9b3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5', 'volume_size': 1} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:42 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290" returned: 0 in 0.762s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:42 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:43 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 1073741824" returned: 0 in 0.785s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:43 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290 Jun 04 15:05:43 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:43 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 Jun 04 15:05:43 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:43 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:43 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807" returned: 0 in 0.570s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.280s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247095049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e15cb8c7e14522aea36803b4ccdf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:34Z,use_quota=True,user_id='3bd64ae4dafd4d649b3591d0ea384bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Creating volume b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:43 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-d8d34fa6-b597-4fdc-9847-e879257a6290" returned: 0 in 0.653s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:43 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca 1073741824 Jun 04 15:05:43 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-d8d34fa6-b597-4fdc-9847-e879257a6290" released by "delete_volume" :: held 1.533s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170ea79f-efdb-453d-91c6-58dc3b0e84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559fa7f0-124f-4344-a6c9-5e1be15e2807', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f42a7be-07cc-4d88-918f-398622bc5e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:43 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 (559fa7f0-124f-4344-a6c9-5e1be15e2807): created successfully Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f42a7be-07cc-4d88-918f-398622bc5e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (72df7b4d-1ff8-4f37-9dc5-df0cd5d03324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:43 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8f8ca70d-7839-4551-9c4d-1d5f5b2ae5c3 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created volume successfully. Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Created reservations ['eda8dc1d-a3ac-4250-9ae9-83e48b315b79', 'b2c71bfe-8cf7-4ef0-835b-70f94cfad001', '44871ef2-57be-4931-adda-6d13e6810bbf', '5c5f3d28-453c-4239-84ca-223f3a91a800'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:43 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:43 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:43 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-ade539de-fa50-4888-b74d-19b94942be16-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-ade539de-fa50-4888-b74d-19b94942be16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "cinder-quobyte-ade539de-fa50-4888-b74d-19b94942be16" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-ade539de-fa50-4888-b74d-19b94942be16" acquired by "delete_volume" :: waited 0.023s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:44 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca 1073741824" returned: 0 in 0.871s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43fe15c-4029-4ee4-999b-4e91a2e1c4c8]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:44 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.760s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:44 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca Jun 04 15:05:44 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:44 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Deleted volume successfully. Jun 04 15:05:44 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-3dbaf1a4-9cb2-4b39-b2c4-8004b0bd9f83 tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-d8d34fa6-b597-4fdc-9847-e879257a6290-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:44 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 Jun 04 15:05:44 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:45 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca" returned: 0 in 0.625s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.275s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-958454455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ee4ed-2771-4c0f-a17e-d8ce7deec735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13c4ebc49f7406b8b89a729374f6b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:41Z,use_quota=True,user_id='8ce3c401b9d04c339e736d1aab1bcaf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Creating volume 943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:45 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31e7497-0603-467f-bd50-370e727dc577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:45 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 1073741824 Jun 04 15:05:45 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b377fdbe-95cd-4712-9b22-9ba4c00a48b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:45 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Volume volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca (b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca): created successfully Jun 04 15:05:45 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b377fdbe-95cd-4712-9b22-9ba4c00a48b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Flow 'volume_create_manager' (642f045a-7ccd-4b83-9af7-ac8aba82150c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16" returned: 0 in 0.733s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:45 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-8c2c5e0c-dff1-4178-a10d-22e1483ccc06 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created volume successfully. Jun 04 15:05:45 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16 Jun 04 15:05:45 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-quobyte-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca" acquired by "delete_volume" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffee41d4-994a-46e3-a44d-b34ce7f1e6ac]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:45 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca Jun 04 15:05:45 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:45 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-ade539de-fa50-4888-b74d-19b94942be16" returned: 0 in 0.672s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-quobyte-ade539de-fa50-4888-b74d-19b94942be16" released by "delete_volume" :: held 1.449s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:45 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Created reservations ['7e875ec4-ae97-454e-810f-7d2ab50bd23b', '57db38f4-6f60-400a-ae6d-e7c11bc22e9b', 'a7997449-4743-46a0-9a95-846f56f0c053', '96fb1f4b-72ea-4efa-ba15-4fccd3a646d1'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:46 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 1073741824" returned: 0 in 0.864s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:46 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:46 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:46 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:05:46 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:46 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca" returned: 0 in 0.799s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:46 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca Jun 04 15:05:46 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:46 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.596s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Deleted volume successfully. Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-0c08e0ad-1f9b-405e-8883-e69a2853cf7e tempest-CinderUnicodeTest-2050076112 None] Lock "cinder-ade539de-fa50-4888-b74d-19b94942be16-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:46 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.667s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.328s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1272510120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54774fb3-d3d4-43f5-b010-6a80e5d9b3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7ba127d7a44c5a472f16bf7bb405e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:42Z,use_quota=True,user_id='c146acf7f37841989442655aaeeca72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)}" {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Creating volume 54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:46 devstack cinder-volume[86522]: INFO cinder.volume.drivers.remotefs [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] casted to osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 1073741824 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04863caf-311f-4991-beb2-c92faeb8f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b3028a-a370-419a-b0f8-e8e9de104e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:46 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 1073741824 Jun 04 15:05:46 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:46 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Volume volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 (943ee4ed-2771-4c0f-a17e-d8ce7deec735): created successfully Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b3028a-a370-419a-b0f8-e8e9de104e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:46 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Flow 'volume_create_manager' (b7aab240-bb1a-469b-8f49-2d1628364cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:46 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9b50b1e3-8401-4c2a-b9cc-d37f1772ee3e tempest-SnapshotDependencyTests-726320958 None] Created volume successfully. Jun 04 15:05:47 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca" returned: 0 in 0.681s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca" released by "delete_volume" :: held 1.547s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created reservations ['f221f254-9ce5-4d86-acb3-371dc4f6d652', '08d14f2c-95a2-4060-9201-e42ffcccc237', '323fa5e2-675d-4eca-a5ac-ca336ab3a817', '6184cb8d-f535-4f61-9011-c62ec9b975b7'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:47 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:47 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:47 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 1073741824" returned: 0 in 1.003s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:47 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:05:47 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-559fa7f0-124f-4344-a6c9-5e1be15e2807-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:47 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-559fa7f0-124f-4344-a6c9-5e1be15e2807-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-quobyte-559fa7f0-124f-4344-a6c9-5e1be15e2807" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-559fa7f0-124f-4344-a6c9-5e1be15e2807" acquired by "delete_volume" :: waited 0.021s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21cb29-e881-48ed-81a4-f0dc85e17607]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:48 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.831s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Deleted volume successfully. Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e657a976-17f4-451c-bb1e-005f5385d8fa tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-b5ea9403-f3e1-4366-bb7c-9e7e1a1028ca-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:48 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 Jun 04 15:05:48 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:48 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.785s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'} {{(pid=86522) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.167s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Creating offline snapshot a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec of volume 943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1605a7f3-ad66-4a53-8841-19a0f7ff49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5', 'volume_size': 1}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18608c10-9167-481b-99ed-8e9a1dfe798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b237402-b2af-499d-9c61-5799e7196e96]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:48 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Volume volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 (54774fb3-d3d4-43f5-b010-6a80e5d9b3c5): created successfully Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18608c10-9167-481b-99ed-8e9a1dfe798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Flow 'volume_create_manager' (ef8f5f01-8ffe-4e5f-8433-6ed5a654ea09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:48 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-ef54848e-c1b6-454b-97ee-42590286519f tempest-VolumeDependencyTests-1377696006 None] Created volume successfully. Jun 04 15:05:48 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:05:48 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:48 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807" returned: 0 in 0.829s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:48 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:48 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807 Jun 04 15:05:48 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:49 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.751s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:49 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec 1G Jun 04 15:05:49 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:49 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-559fa7f0-124f-4344-a6c9-5e1be15e2807" returned: 0 in 0.591s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-559fa7f0-124f-4344-a6c9-5e1be15e2807" released by "delete_volume" :: held 1.474s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created reservations ['b3d9504b-f41d-45c3-82e0-cc4aa73182a6', '9d6ededb-919b-494b-9189-25999e5eecca', 'ac292b38-6119-422e-987d-b2fc8900dcb4', '3ce3892d-764e-4bca-ae9a-d722c8852142'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:49 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:49 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:49 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:50 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec 1G" returned: 0 in 0.756s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:50 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec Jun 04 15:05:50 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-6e59a655-6a7a-472a-aab9-3f1b7a3490ce-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-6e59a655-6a7a-472a-aab9-3f1b7a3490ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:50 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.672s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:50 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Deleted volume successfully. Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-7648fcdb-d753-4043-82b5-5545d3bf5e29 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-559fa7f0-124f-4344-a6c9-5e1be15e2807-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-quobyte-6e59a655-6a7a-472a-aab9-3f1b7a3490ce" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-6e59a655-6a7a-472a-aab9-3f1b7a3490ce" acquired by "delete_volume" :: waited 0.013s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325132a-fcb0-4b61-8cb4-40d33ca1f209]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:50 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce Jun 04 15:05:50 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:50 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" returned: 0 in 0.689s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:50 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec is being set with open permissions: ugo+rw Jun 04 15:05:50 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:50 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec Jun 04 15:05:50 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:51 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce" returned: 0 in 0.710s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:51 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce Jun 04 15:05:51 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:51 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" returned: 0 in 0.602s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:51 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info Jun 04 15:05:51 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:51 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-6e59a655-6a7a-472a-aab9-3f1b7a3490ce" returned: 0 in 0.628s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-6e59a655-6a7a-472a-aab9-3f1b7a3490ce" released by "delete_volume" :: held 1.381s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created reservations ['539d7f75-a616-4c89-9666-fdbc512baa1d', 'c2f91831-6f96-491d-8da4-62f1d6b8348a', '77a90f3a-9773-4221-98b4-db800aee8dc4', '1b0ec61c-244f-45d1-854e-bcd588e70142'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:51 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:51 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:51 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:52 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info" returned: 0 in 0.609s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:52 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info is being set with open permissions: ugo+rw Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:52 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info Jun 04 15:05:52 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:52 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.586s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:52 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Deleted volume successfully. Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-be95e15e-0153-4053-abbc-9b9f5a22b83e tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-6e59a655-6a7a-472a-aab9-3f1b7a3490ce-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-fc83560b-0992-46cf-97f9-b1db16ec559a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-fc83560b-0992-46cf-97f9-b1db16ec559a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-quobyte-fc83560b-0992-46cf-97f9-b1db16ec559a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-fc83560b-0992-46cf-97f9-b1db16ec559a" acquired by "delete_volume" :: waited 0.018s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ef3aaa-c2ff-4d16-b6f3-806ab50273b7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:52 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a Jun 04 15:05:52 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:52 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.info" returned: 0 in 0.633s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.584s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Creating offline snapshot 6af96d33-edfc-433f-b014-7c808b8944b7 of volume 54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 04 15:05:52 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-9cb17aa9-ee52-488c-ab0b-4b6cef8ab60b tempest-SnapshotDependencyTests-726320958 None] Create snapshot completed successfully Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[389b7cf0-148f-474c-b3c9-2dc16d588e99]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:52 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:53 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:05:53 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:53 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a" returned: 0 in 0.716s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:53 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a Jun 04 15:05:53 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:53 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.753s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:53 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 1G {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:53 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 1G Jun 04 15:05:53 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:54 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-fc83560b-0992-46cf-97f9-b1db16ec559a" returned: 0 in 0.664s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-fc83560b-0992-46cf-97f9-b1db16ec559a" released by "delete_volume" :: held 1.429s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created reservations ['ceee37e8-b9f3-430f-b6e0-b534f88ed368', 'a2cd9954-c5be-4e08-978f-a8548359fd9c', '6504d197-3528-4f47-a8ab-d6782bea81a1', '1f0d0f38-2cbf-4c51-9cd1-d25fd0849fe2'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:54 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:54 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Flow 'volume_create_manager' (912807df-83ad-437e-aa5c-a824b0358f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d861009a-0e45-4b02-ba20-066d1ee89b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d861009a-0e45-4b02-ba20-066d1ee89b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f55ec5-1d9b-4e1b-bb58-501256160624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13c4ebc49f7406b8b89a729374f6b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:54Z,use_quota=True,user_id='8ce3c401b9d04c339e736d1aab1bcaf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f099c2af-36a2-41a4-9619-97d756f64ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f099c2af-36a2-41a4-9619-97d756f64ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849628a6-3a5c-4c48-9a15-60196824978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849628a6-3a5c-4c48-9a15-60196824978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90f55ec5-1d9b-4e1b-bb58-501256160624', 'volume_name': 'volume-90f55ec5-1d9b-4e1b-bb58-501256160624', 'volume_size': 1, 'snapshot_id': 'a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063ee8f0-12bb-4803-b4cb-0fcc7fe166c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063ee8f0-12bb-4803-b4cb-0fcc7fe166c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b14ce20-f033-4001-ab0f-9763b6c2c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:54 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Volume 90f55ec5-1d9b-4e1b-bb58-501256160624: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90f55ec5-1d9b-4e1b-bb58-501256160624', 'volume_size': 1, 'snapshot_id': 'a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec'} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:54 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 1G" returned: 0 in 0.857s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:54 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 Jun 04 15:05:54 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-244c0f9d-a055-4a10-82bb-91cf65435258-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-244c0f9d-a055-4a10-82bb-91cf65435258-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:54 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.678s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:54 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Deleted volume successfully. Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-quobyte-244c0f9d-a055-4a10-82bb-91cf65435258" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-af21e9a1-d876-49e1-9787-7d98233b67b8 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-fc83560b-0992-46cf-97f9-b1db16ec559a-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-244c0f9d-a055-4a10-82bb-91cf65435258" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed07ed67-4877-495f-8448-cc98b51dffa7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:54 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:55 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 Jun 04 15:05:55 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:55 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 -F qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7" returned: 0 in 0.683s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:55 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 is being set with open permissions: ugo+rw Jun 04 15:05:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:55 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 Jun 04 15:05:55 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:55 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258" returned: 0 in 0.732s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:55 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258 Jun 04 15:05:55 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:55 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7" returned: 0 in 0.646s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:55 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:55 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info Jun 04 15:05:55 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:56 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-244c0f9d-a055-4a10-82bb-91cf65435258" returned: 0 in 0.624s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-244c0f9d-a055-4a10-82bb-91cf65435258" released by "delete_volume" :: held 1.397s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created reservations ['13627f94-c2b2-4746-a314-be048cdac1bc', 'b1729d3d-8fa0-47d1-b0fb-1767b2a8e721', '043ee445-7722-4278-a25e-8160e41547b8', '6bb6b565-b820-4d98-970d-f800ecba2c8e'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:56 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:56 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:56 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info" returned: 0 in 0.649s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:56 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info is being set with open permissions: ugo+rw Jun 04 15:05:56 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:56 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info Jun 04 15:05:56 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-e9d011ea-1673-49e7-b58d-51ab2e0a855c-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-e9d011ea-1673-49e7-b58d-51ab2e0a855c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:57 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.661s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "cinder-quobyte-e9d011ea-1673-49e7-b58d-51ab2e0a855c" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Deleted volume successfully. Jun 04 15:05:57 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.info" returned: 0 in 0.613s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.306s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-e9d011ea-1673-49e7-b58d-51ab2e0a855c" acquired by "delete_volume" :: waited 0.039s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.715s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-quobyte-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec-90f55ec5-1d9b-4e1b-bb58-501256160624" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f4831-f5eb-49c4-87a3-629fe6a27d39]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec-90f55ec5-1d9b-4e1b-bb58-501256160624" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Creating volume 90f55ec5-1d9b-4e1b-bb58-501256160624 from snapshot a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-quobyte-90f55ec5-1d9b-4e1b-bb58-501256160624" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-91b1c353-fc9e-4897-aea7-27341aa8a158 tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-244c0f9d-a055-4a10-82bb-91cf65435258-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:57 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4a6c0527-f33d-44c7-8920-2f452d9d4975 tempest-VolumeDependencyTests-1377696006 None] Create snapshot completed successfully Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-90f55ec5-1d9b-4e1b-bb58-501256160624" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] snapshot: a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec, volume: 90f55ec5-1d9b-4e1b-bb58-501256160624, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[14445184-86a9-465e-8ea4-268d9a0654ba]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:57 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c Jun 04 15:05:57 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:57 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec Jun 04 15:05:57 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:57 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c" returned: 0 in 0.774s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:57 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:57 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c Jun 04 15:05:57 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:58 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" returned: 0 in 0.845s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86522) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d847167-2fdc-4346-a6fa-aaba925112e0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Flow 'volume_create_manager' (0864a1e5-1920-47d0-9f96-0239a92a2ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784f57ae-5080-496c-b172-233219f7a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784f57ae-5080-496c-b172-233219f7a69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T13:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-143312136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2862ad9-356f-419c-9f70-7d90d867ef9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7ba127d7a44c5a472f16bf7bb405e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T13:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6af96d33-edfc-433f-b014-7c808b8944b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T13:05:58Z,use_quota=True,user_id='c146acf7f37841989442655aaeeca72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5028691-3fe4-474c-8748-f539120b3b07),volume_type_id=b5028691-3fe4-474c-8748-f539120b3b07)' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a716df11-4b3a-43f7-a108-77c1102a6dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a716df11-4b3a-43f7-a108-77c1102a6dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a874124f-9d65-46e0-93d0-f70707ea3f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a874124f-9d65-46e0-93d0-f70707ea3f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2862ad9-356f-419c-9f70-7d90d867ef9a', 'volume_name': 'volume-a2862ad9-356f-419c-9f70-7d90d867ef9a', 'volume_size': 1, 'snapshot_id': '6af96d33-edfc-433f-b014-7c808b8944b7'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8981aa-2372-4611-8767-74bc706e5cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8981aa-2372-4611-8767-74bc706e5cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49e7c10-0750-4c40-ae7d-6f838de334a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:05:58 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Volume a2862ad9-356f-419c-9f70-7d90d867ef9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2862ad9-356f-419c-9f70-7d90d867ef9a', 'volume_size': 1, 'snapshot_id': '6af96d33-edfc-433f-b014-7c808b8944b7'} Jun 04 15:05:58 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:58 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:58 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-e9d011ea-1673-49e7-b58d-51ab2e0a855c" returned: 0 in 0.697s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-quobyte-e9d011ea-1673-49e7-b58d-51ab2e0a855c" released by "delete_volume" :: held 1.519s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Created reservations ['35c3b73c-a10f-495f-998a-a1b07fafc97b', '1f2998b4-ca02-47f1-bd0c-06cff137175f', '9954e5a2-28ea-4ea1-a4b3-d709ddf2c3b4', '0cb95429-dd1a-4c30-aefd-e9b75be47c09'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:58 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:05:58 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:58 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.791s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 15:05:58 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:05:58 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 Jun 04 15:05:58 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:05:59 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jun 04 15:05:59 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.609s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:05:59 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:05:59 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Deleted volume successfully. Jun 04 15:05:59 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-cc9ee547-f8a4-408b-8d7b-4df6104ad00d tempest-CreateVolumesFromSourceVolumeTest-1258433667 None] Lock "cinder-e9d011ea-1673-49e7-b58d-51ab2e0a855c-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:04 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624" returned: 0 in 5.041s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:04 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[79743214-3d4a-4766-9db9-0184e1a832d7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:04 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:06:04 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:04 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.820s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:04 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:06:04 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Converted 1024.00 MB image at 203.11 MB/s Jun 04 15:06:04 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 is being set with open permissions: ugo+rw Jun 04 15:06:04 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:04 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 Jun 04 15:06:04 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:05 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624" returned: 0 in 0.582s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-90f55ec5-1d9b-4e1b-bb58-501256160624" released by "_copy_volume_from_snapshot" :: held 8.204s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec-90f55ec5-1d9b-4e1b-bb58-501256160624" released by "_create_volume_from_snapshot" :: held 8.253s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.290s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.142s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-quobyte-6af96d33-edfc-433f-b014-7c808b8944b7-a2862ad9-356f-419c-9f70-7d90d867ef9a" by "_create_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-6af96d33-edfc-433f-b014-7c808b8944b7-a2862ad9-356f-419c-9f70-7d90d867ef9a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Creating volume a2862ad9-356f-419c-9f70-7d90d867ef9a from snapshot 6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Selected osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975 as target Quobyte volume. {{(pid=86522) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-quobyte-a2862ad9-356f-419c-9f70-7d90d867ef9a" by "_copy_volume_from_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b14ce20-f033-4001-ab0f-9763b6c2c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f55ec5-1d9b-4e1b-bb58-501256160624', 'volume_size': 1, 'snapshot_id': 'a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a0fab0-65be-4019-b069-ca55cbcc1149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-a2862ad9-356f-419c-9f70-7d90d867ef9a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] snapshot: 6af96d33-edfc-433f-b014-7c808b8944b7, volume: a2862ad9-356f-419c-9f70-7d90d867ef9a, {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 15:06:05 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Volume volume-90f55ec5-1d9b-4e1b-bb58-501256160624 (90f55ec5-1d9b-4e1b-bb58-501256160624): created successfully Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a0fab0-65be-4019-b069-ca55cbcc1149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Flow 'volume_create_manager' (912807df-83ad-437e-aa5c-a824b0358f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9731731-703a-4241-b96b-1b80651e2fa9]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:05 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:05 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-5e98519b-3135-451b-8714-4802e1e7460d tempest-SnapshotDependencyTests-726320958 None] Created volume successfully. Jun 04 15:06:05 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 Jun 04 15:06:05 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:06 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7" returned: 0 in 0.699s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Creating direct copy from snapshot {{(pid=86522) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0749c1e-a676-4a28-818f-5e0ee6336d0e]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-quobyte-943ee4ed-2771-4c0f-a17e-d8ce7deec735" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-943ee4ed-2771-4c0f-a17e-d8ce7deec735" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-quobyte-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Deleting offline snapshot a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec of volume 943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] snapshot_file for this snap is: volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e66ed8-ae3c-4088-935e-c383be024c36]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:06 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:06 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:06:06 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:06 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec Jun 04 15:06:06 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:07 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG cinder.utils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Path /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a not found in is_blk_device check {{(pid=86522) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:07 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a Jun 04 15:06:07 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:07 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" returned: 0 in 0.717s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[a061563a-065d-42c1-8aff-da0f3189903b]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:07 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:07 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:06:07 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:08 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.970s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:08 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:08 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec Jun 04 15:06:08 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:09 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" returned: 0 in 1.317s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:09 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:09 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec Jun 04 15:06:09 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:10 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:10 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735.a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" returned: 0 in 0.928s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec" released by "_delete_snapshot" :: held 4.108s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-943ee4ed-2771-4c0f-a17e-d8ce7deec735" released by "delete_snapshot" :: held 4.143s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:10 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Created reservations ['9c118380-9d08-4736-817e-59a1d8abf839', 'a2fbc226-9370-4d2d-9662-33e3d8875361', 'ec219f4e-36ff-43a7-8771-ec7b68b5f53e', '7641e1c9-1cf8-468e-8091-27a5d7f4b745'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:06:10 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Delete snapshot completed successfully. Jun 04 15:06:10 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-69b8c220-c970-4864-be30-7a6c01e7b3a3 tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-a2a2fc64-ba2f-406c-bde7-3a32b4edc4ec-delete_snapshot" released by "delete_snapshot" :: held 4.437s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-943ee4ed-2771-4c0f-a17e-d8ce7deec735-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-943ee4ed-2771-4c0f-a17e-d8ce7deec735-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-quobyte-943ee4ed-2771-4c0f-a17e-d8ce7deec735" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-943ee4ed-2771-4c0f-a17e-d8ce7deec735" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:11 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e194c7-1968-467c-a838-cc99a3d96236]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a" returned: 0 in 4.834s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f05b1f-a590-43e0-8abf-f10f5c234409]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:11 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:11 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:06:11 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:12 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:06:12 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:12 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.694s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:12 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735 Jun 04 15:06:12 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:12 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.846s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:12 devstack cinder-volume[86522]: DEBUG cinder.image.image_utils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a {{(pid=86522) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 04 15:06:12 devstack cinder-volume[86522]: INFO cinder.image.image_utils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Converted 1024.00 MB image at 211.72 MB/s Jun 04 15:06:12 devstack cinder-volume[86522]: WARNING cinder.volume.drivers.remotefs [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a is being set with open permissions: ugo+rw Jun 04 15:06:12 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:12 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a Jun 04 15:06:12 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:13 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-943ee4ed-2771-4c0f-a17e-d8ce7deec735" returned: 0 in 0.607s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-943ee4ed-2771-4c0f-a17e-d8ce7deec735" released by "delete_volume" :: held 1.363s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Created reservations ['617bf576-6b9c-41ea-80be-6a1df140bc65', '24c51ea5-f6fc-43e5-95c6-63b65d99dd45', '27cf104c-8bee-456e-9815-18b2aa53667c', '5dd9f6bd-f024-49c7-b463-d97ea5bc8645'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:13 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a" returned: 0 in 0.576s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:13 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:06:13 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-a2862ad9-356f-419c-9f70-7d90d867ef9a" released by "_copy_volume_from_snapshot" :: held 7.841s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-6af96d33-edfc-433f-b014-7c808b8944b7-a2862ad9-356f-419c-9f70-7d90d867ef9a" released by "_create_volume_from_snapshot" :: held 7.886s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.910s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49e7c10-0750-4c40-ae7d-6f838de334a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2862ad9-356f-419c-9f70-7d90d867ef9a', 'volume_size': 1, 'snapshot_id': '6af96d33-edfc-433f-b014-7c808b8944b7'}' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed34e879-24cd-4133-ae20-d342b3f27fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 15:06:13 devstack cinder-volume[86522]: INFO cinder.volume.flows.manager.create_volume [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Volume volume-a2862ad9-356f-419c-9f70-7d90d867ef9a (a2862ad9-356f-419c-9f70-7d90d867ef9a): created successfully Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed34e879-24cd-4133-ae20-d342b3f27fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86522) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Flow 'volume_create_manager' (0864a1e5-1920-47d0-9f96-0239a92a2ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86522) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 15:06:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-d21eab9c-8d4a-4f23-8de7-9e80d84c4229 tempest-VolumeDependencyTests-1377696006 None] Created volume successfully. Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-6af96d33-edfc-433f-b014-7c808b8944b7-delete_snapshot" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-6af96d33-edfc-433f-b014-7c808b8944b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-quobyte-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" by "delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-quobyte-6af96d33-edfc-433f-b014-7c808b8944b7" by "_delete_snapshot" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-6af96d33-edfc-433f-b014-7c808b8944b7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Deleting offline snapshot 6af96d33-edfc-433f-b014-7c808b8944b7 of volume 54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] snapshot_file for this snap is: volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c45289-d4a9-433f-8695-3d7276332fd7]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:13 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 Jun 04 15:06:13 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:13 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.609s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:06:13 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Deleted volume successfully. Jun 04 15:06:13 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-60f2dfe7-b0b5-45af-80fd-6a19084e840d tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-943ee4ed-2771-4c0f-a17e-d8ce7deec735-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-90f55ec5-1d9b-4e1b-bb58-501256160624-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-90f55ec5-1d9b-4e1b-bb58-501256160624-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "cinder-quobyte-90f55ec5-1d9b-4e1b-bb58-501256160624" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-90f55ec5-1d9b-4e1b-bb58-501256160624" acquired by "delete_volume" :: waited 0.016s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d881f-981b-4208-b743-e73bb3f1a3af]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:14 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 Jun 04 15:06:14 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:14 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7" returned: 0 in 0.707s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.remotefs [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86522) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[37935289-18c9-49eb-98a3-70b8491e19b0]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:14 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:06:14 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:14 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624" returned: 0 in 0.728s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:14 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:14 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624 Jun 04 15:06:14 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:15 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.729s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:15 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 Jun 04 15:06:15 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:15 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-90f55ec5-1d9b-4e1b-bb58-501256160624" returned: 0 in 0.584s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-quobyte-90f55ec5-1d9b-4e1b-bb58-501256160624" released by "delete_volume" :: held 1.349s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Created reservations ['530c0a36-db93-4c17-90f6-f534b300a70a', '147462c9-c24e-4921-9023-de6617d67b9c', '3cc352be-aada-4c79-acde-1a9c9a812835', 'cac9ed7a-3f1b-469b-8fe5-3e01c212f14d'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:15 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:06:15 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:15 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7" returned: 0 in 0.708s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:15 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:15 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7 Jun 04 15:06:15 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:16 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.615s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:06:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Deleted volume successfully. Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-99dd74dc-533f-4c3b-b626-bbbc7ac2291a tempest-SnapshotDependencyTests-726320958 None] Lock "cinder-90f55ec5-1d9b-4e1b-bb58-501256160624-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:16 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5.6af96d33-edfc-433f-b014-7c808b8944b7" returned: 0 in 0.635s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-6af96d33-edfc-433f-b014-7c808b8944b7" released by "_delete_snapshot" :: held 2.895s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" released by "delete_snapshot" :: held 2.923s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Created reservations ['e1519fc4-8675-43c2-b374-b00ba4fad480', '91b6e42d-d8a9-406f-8da7-2f6cd716a375', '7803005c-b980-47c7-b844-bfebc81097ae', '0a75fdfd-bb14-4eef-9c9b-cebbd470bc9b'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:06:16 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Delete snapshot completed successfully. Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e6b12b6a-b431-4e9b-a89c-ea5b5fe14c2d tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-6af96d33-edfc-433f-b014-7c808b8944b7-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-quobyte-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:16 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:17 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[e461abdc-c081-4788-b4fe-4a8a6bb194e4]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:17 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:06:17 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:17 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.739s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:17 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:17 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5 Jun 04 15:06:17 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:18 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" returned: 0 in 0.615s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5" released by "delete_volume" :: held 1.433s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Created reservations ['8be6fab0-90ce-4c1e-aa12-8bb5b5368806', '0064167a-aa8f-4469-b340-cd208292b9ea', '0e45fcc1-5117-43aa-a418-6d425dfdf62b', '9acffdf4-50dd-4916-b46a-f6dab3ed5630'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:18 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:18 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:06:18 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-a2862ad9-356f-419c-9f70-7d90d867ef9a-delete_volume" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:19 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.633s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:06:19 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Deleted volume successfully. Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-a2862ad9-356f-419c-9f70-7d90d867ef9a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-4971a8e7-0599-4a24-a43f-6092b57b6e76 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-54774fb3-d3d4-43f5-b010-6a80e5d9b3c5-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "cinder-quobyte-a2862ad9-356f-419c-9f70-7d90d867ef9a" by "delete_volume" {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-a2862ad9-356f-419c-9f70-7d90d867ef9a" acquired by "delete_volume" :: waited 0.020s {{(pid=86522) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5bfef1-8c48-4f94-8862-b1a5ac900da3]: (4, 'qcow2') {{(pid=87871) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 15:06:19 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:19 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a Jun 04 15:06:19 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:20 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a" returned: 0 in 0.732s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:20 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a Jun 04 15:06:20 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:20 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c/volume-a2862ad9-356f-419c-9f70-7d90d867ef9a" returned: 0 in 0.615s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-quobyte-a2862ad9-356f-419c-9f70-7d90d867ef9a" released by "delete_volume" :: held 1.395s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG cinder.quota [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Created reservations ['1f84a44f-82e1-44f7-8ef2-e7bf35b90b23', 'd4635ae8-723a-47e6-a84d-fc0a406d68a9', '6ea8ac24-b4c4-43ed-aadd-e5aa1b3ba918', 'e8a36436-b57e-4138-bc5d-4e46d89c722f'] {{(pid=86522) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:20 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:20 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:06:20 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:21 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:21 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.641s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:21 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:06:21 devstack cinder-volume[86522]: INFO cinder.volume.manager [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Deleted volume successfully. Jun 04 15:06:21 devstack cinder-volume[86522]: DEBUG cinder.coordination [None req-e0cd017b-a414-41ad-88f6-05f20d07a8f9 tempest-VolumeDependencyTests-1377696006 None] Lock "cinder-a2862ad9-356f-419c-9f70-7d90d867ef9a-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=86522) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG oslo_service.periodic_task [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86522) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975': None} {{(pid=86522) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG cinder.volume.drivers.quobyte [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9875da60-788e-4687-a5fb-87bb07429975'] {{(pid=86522) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.lockutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86522) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 15:06:22 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 15:06:22 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c Jun 04 15:06:22 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 15:06:23 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jun 04 15:06:23 devstack cinder-volume[86522]: DEBUG oslo_concurrency.processutils [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ddf20e0d558faaf6437d153f92ad42c" returned: 0 in 0.731s {{(pid=86522) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 15:06:23 devstack cinder-volume[86522]: DEBUG cinder.manager [None req-f48083d6-e82d-4841-8289-1b0d411e4f97 None None] Notifying Schedulers of capabilities ... {{(pid=86522) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 04 15:06:30 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:SELECT=81,cinder:INSERT=34,cinder:UPDATE=140,cinder:DELETE=10 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 15:06:31 devstack cinder-volume[86522]: DEBUG dbcounter [-] [86522] Writing DB stats cinder:UPDATE=127,cinder:SELECT=109,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86522) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}